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1 METHOD AND APPARATUS FOR DECODING 

OF TURBO ENCODED DATA 

FIELD OF THE INVENTION 
5 The invention relates to methods, apparatus, and signals used in channel coding and 

decoding, and, in particular embodiments to methods, apparatus and signals for use with 
turbo and turbo-trellis encoding and decoding for communication channels. 

BACKGROUND OF THE INVENTION 
10 A significant amount of interest has recently been paid to channel coding. For 

example a recent authoritative text states: 

"Channel coding refers to the class of signal transformations designed to improve 
communications performance by enabling the transmitted signals to better withstand the 
effects of various channel impairments, such as noise, interference, and fading. These signal- 

1 5 processing techniques can be thought of as vehicles for accomplishing desirable system trade- 
offs (e.g., error-performance versus bandwidth, power versus bandwidth). Why do you 
suppose channel coding has become such a popular way to bring about these beneficial 
effects? The use of large-scale integrated circuits (LSI) and high-speed digital signal 
processing (DSP) techniques have made it possible to provide as much as 10 dB performance 

20 improvement through these methods, at much less cost than through the use of most other 
methods such as higher power transmitters or larger antennas." 

From "Digital Communications" Fundamentals and Applications Second Edition by 
Bernard Sklar, page 305 © 2001 Prentice Hall PTR. 

Stated differently, improved coding techniques may provide systems that can operate at 

25 lower power or may be used to provide higher data rates. 
Conventions and Definitions: 

Particular aspects of the invention disclosed herein depend upon and are sensitive to 
the sequence and ordering of data. To improve the clarity of this disclosure the following 
convention is adopted. Usually, items are listed in the order that they appear. Items listed as 

30 #1, #2, #3 are expected to appear in the order #1, #2, #3 listed, in agreement with the way 

they are read, i.e. from left to right. However, in engineering drawings, it is common to show 
a sequence being presented to a block of circuitry, with the right most tuple representing the 
earliest sequence, as shown in Figure 2, where 207 is the earliest tuple, followed by tuple 209. 
The IEEE Standard Dictionary of Electrical and Electronics Terms, Sixth Edition, defines 

35 tuple as a suffix meaning an ordered set of terms (sequence) as in N-tuple. A tuple as used 
herein is merely a grouping of bits having a relationship to each other. 

-1- 
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Herein, the convention is adopted that items, such as tuples will be written in the same 
convention as the drawings. That is in the order that they sequentially proceed in a circuit. 
For example, "Tuples 207 and 209 are accepted by block 109" means tuple 207 is accepted 
first and then 209 is accepted, as is seen in Figure 2. In other words the text will reflect the 
sequence implied by the drawings. Therefore a description of Figure 2 would say "tuples 207 
and 209 are provided to block 109" meaning that tuple 207 is provided to block 1 09 before 
tuple 209 is provided to block 109. 

Herein an interleaver is defined as a device having an input and an output. The input 
accepting data tuples and the output providing data tuples having the same component bits as 
the input tuples, except for order. 

An integral tuple (IT) interleaver is defined as an interleaver that reorders tuples that 
have been presented at the input, but does not separate the component bits of the input tuples. 
That is the tuples remain as integral units and adjacent bits in an input tuple will remain 
adjacent, even though the tuple has been relocated. The tuples, which are output from an IT 
interleaver are the same as the tuples input to interleaver, except for order. Hereinafter when 
the term interleaver is used, an IT interleaver will be meant. 

A separable tuple (ST) interleaver is defined as an interleaver that reorders the tuples 
input to it in the same manner as an IT interleaver, except that the bits in the input tuples are 
interleaved independently, so that bits that are adjacent to each other in an input tuple are 
interleaved separately and are interleaved into different output tuples. Each bit of an input 
tuple, when interleaved in an ST interleaver, will typically be found in a different tuple than 
the other bits of the input tuple from where it came. Although the input bits are interleaved 
separately in an ST interleaver, they are generally interleaved into the same position within 
the output tuple as they occupied within the input tuple. So for example, if an input tuple 
comprising two bits, a most significant bit and a least significant bit, is input into an ST 
interleaver the most significant bit will be interleaved into the most significant bit position in 
a first output tuple and the least significant bit will be interleaved into the least significant bit 
position in a second output tuple. 

Modulo-N sequence designation is a term meaning the modulo-N of the position of an 
element in a sequence. If there are k item s (I) in a sequence then the items have ordinal 
numbers 0 to k-1, i.e. I„ through I^.,, representing the position of each time in the sequence. 
The first item in the sequence occupies position 0, the second item in a sequence I, occupies 
position 1, the third item in the sequence I 2 occupies position 2 and so forth up to item I k .„ 
which occupies the k'th or last position in the sequence. The modulo-N sequence designation 
is equal to the position of the item in the sequence modulo-N . For example, the modulo-2 
sequence designation of I 0 =0, the modulo-2 sequence designation of 1,-1, and the modulo-2 
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1 sequence designation of I 2 =0 and so forth. 

A modulo-N interleaver is defined as an interleaver wherein the interleaving function 

depends on the modulo-N value of the tuple input to the interleaver. Modulo interleaves are 

further defined and illustrated herein. 
5 A modulo-N encoding system is one that employs one or more modulo interleaves. 

SUMMARY OF EMBODIMENTS OF THE INVENTION 

In one aspect of the invention a method for computing extrinsic likelihood values in a 
soft in soft out (SISO) decoder is disclosed. The method includes accepting a block of 

1 0 channel metrics and a priori values, dividing the block of channel metrics and a priori values 
into sub blocks, accepting an nth channel metric and an nth a priori value into an alpha (a) 
computer; computing a nth a value from the nth channel metric and an nth a priori value, 
using the nth alpha value to compute the n+1 alpha value, pushing a values corresponding to 
the beginning of a sub block on a checkpoint stack until a beginning of the last sub block is 

1 5 reached, pushing each of the a values of the final sub block on the checkpoint stack, popping 
each of the final alpha values from the checkpoint stack and combining them with beta 
values to form extrinsic likelihood values. 

In one aspect of the invention a method for computing extrinsic likelihood values in a 
soft in soft out (SISO) decoder is disclosed. The method includes accepting a block of 

20 channel metrics and a priori values, dividing the block of channel' metrics and a priori values 
into sub blocks, accepting an nth channel metric and an nth a priori value into an alpha 
computer, computing a nth a value from the nth channel metric and an nth a priori value, 
using the nth a value to compute the n+1 alpha value, pushing alpha values corresponding to 
the beginning of a sub block on checkpoint stack until a beginning of the last sub block is 

25 reached, pushing each of the alpha values, once the beginning of the last sub block has been 
reached, on a first computation stack to form a first set of alpha values, popping a values of 
the first set of a values from the first computation stack once the last value of a of the sub 
block has been computed stack and combining a values from the first set of a values with 
beta values to form extrinsic likelihood values. 

30 In one aspect of the invention an apparatus for computing extrinsic likelihood values in 

a soft in soft out (SISO) decoder is disclosed. The apparatus includes an alpha (a) computer 
that receives a priori values and channel metrics and computes a values, a checkpoint stack 
for receiving a checkpoint values from the a computer a p computer that receives a priori 
values and channel metrics and computes P values; and an extrinsic calculator that accepts a 

35 values provided by the a computer and P values provided by the P computer and produces 
extrinsic likelihood values. 
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In one aspect of the invention a method of computing extrinsic values for a block of 
metrics and corresponding a priori values the method includes computing a values and saving 
only checkpoint values on a stack, computing a values between checkpoint values when such 
values are required. 

In one aspect of the invention a method of calculating alpha values in a map decoder 
is disclosed. The method includes selecting a state to calculate an alpha value for, 
determining which previous states may result in a transition into the selected state, 
determining a likelihood for each transition from a previous state into the selected state, 
determining the transition having the most likelihood using a min* (min star) operation and 
assigning the alpha value of the selected state to be equal to the result of the min* operation. 

In one aspect of the invention a method for calculating beta values in a map decoder is 
disclosed. The method includes selecting a state to calculate an value for, determining which 
previous states may result in a transition into the selected state, determining a likelihood for 
each transition from a previous state into the selected state, 

determining the transition having the most likelihood using a min* (min star) operation and 
assigning the beta value of the selected 

In one aspect of the invention a method for computing an alpha metric for a selected 
state in a map decoder is disclosed. The method includes determining min_a = minimum of 
the operands comparing a first input (A) and the second input (B), wherein A comprises an a 
metric, a priori values and a transition metric for a first previous state and B comprises an a 
metric, a priori values and a transition metric for a second previous state, outputting minjx 
from the Min* operation wherein minjx comprises the MIN(A,B), a first portion of the 
output of a Min* operation, computing ln_ct ~ -log(l+ e^"* 1 ) as a second portion of a Min* 
operation; and outputting lnji from the Min* operation; 

In another aspect of the invention a method for computing a beta metric for a selected 
state in a map decoder is disclosed. The method cincludes determining min_p = rninirrmm of 
the operands comparing a first input (A) and the second input (B), wherein A comprises an a 
metric, a priori values and a transition metric for a first previous state and B comprises an p 
metric, a priori values and a transition metric for a second previous state, outputting minJJ 
from the Min* operation wherein min JJ comprises the MIN(A,B), a first portion of the 
output of a Min* operation, computing ln_J3 = -log(l+ e"*** 81 ) as a second portion of a Min* 
operation and outputting InJ3 from the Min* operation. 

In one aspect of the invention a method for computing an alpha metric for a selected 
state in a map decoder is disclosed. The method includes determining minjx = minimum of 
the operands comparing a first input (A) and the second input (B), wherein A comprises an a 
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1 metric, a priori values and a transition metric for a first previous state and B comprises an a 
metric, a priori values and a transition metric for a second previous state, dutputting min_a 
from the Min* operation wherein min_a comprises the MIN(A,B), a first portion of the 
output of a Min* operation, computing ln_a = -log(l+ e^ B| ) as a second portion of a Min* 

5 operation; and outputting Injx from the Min* operation; 

In another aspect of the invention a method for computing a beta metric for a selected 
state in a map decoder is disclosed. The method cinciudes determining min_p = minimum of 
the operands comparing a first input (A) and the second input (B), wherein A comprises an a 
metric, a priori values and a transition metric for a first previous state and B comprises an p 

1 0 metric, a priori values and a transition metric for a second previous state, outputting minj} 
from the Min* operation wherein minJJ comprises the MIN(A,B), a first portion of the 
output of a Min* operation, computing InJJ = -log(l+ e*^' 8 ') as a second portion of a Min* 
operation and outputting In Ji from the Min* operation. 

In one aspect of the invention an apparatus for calculating a Min* in a MAP decoder is 

1 5 disclosed. The apparatus includes a circuit for calculating the minimum (Min) of A and B 

where A is the sum of al and a2 and a3, wherein al is the min_a of a previous state, a2 is In- 
_a of the previous state and a3 is equal to a priori values from a previous state plus a 
transition metric from a previous state and B is equal to bl and b2 and b3, wherein bl is the 
minjx of a previous state, b2 is ln_a of the previous state and b3 is equal to a priori values 

20 from a previous state plus a transition metric from a previous state and a circuit for 
calculating -log(l+ e HA * B| ). 

In one aspect of the invention a method of normalizing alpha (a) values in a map 
decoder is disclosed. The method includes detecting when all a values, corresponding to 
branch metrics, have reached a certain value; and subtracting a constant value from all a 

25 values on a next decoder cycle. 

. In one aspect of the invention an apparatus for normalizing alpha (a) values in a map 
decoder is disclosed the apparatus includes a detector which detects when all a values, 
corresponding to branch metrics, have reached a certain value and a subtracter that subtracts a 
constant value from all a values on a next decoder cycle. 

30 In one aspect of the invention a method of normalizing beta values in a map decoder is 

disclosed. The method includes detecting when all peta values, corresponding to branch 
metrics, have reached a certain value; and subtracting a constant value from all p values on a 
next decoder cycle. 

In one aspect of the invention an apparatus for normalizing p values in a map decoder 
35 the apparatus comprising a detector which detects when all P values, corresponding to branch 
metrics, have reached a certain value; and a subtractor which subtracts a constant value from 
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1 all beta values on a next decoder cycle. 

In one aspect of the invention a method for parallel decoding of modulo N turbo 
encoded data is disclosed. The method includes accepting samples of modulo N turbo 
encoded data, calculating metric values for each sample, accepting the metric values into each 

5 of N soft input soft output (SISO) modules, deinterleaving extrinsic values to form a priori 
values, accepting a priori values into each of N soft input soft output (SISO) modules and 
performing decoding calculations within each of the SISOs thereby forming the extrinsic 
values; 

In one aspect of the invention an apparatus for parallel decoding of modulo N turbo 
1 0 encoded data is disclosed. The apparatus includes an input queue that accepts samples of 
modulo N turbo encoded data, a metric calculator that accepts samples of modulo N turbo 
' encoded data from the input queue and calculates the metric values for each sample, N soft 
input soft output (SISO) modules that accept the metric values and an a priori values and 
produce an extrinsic value, and N modulo N deinterleavers that accept an extrinsic value and 
1 5 deinterlieave it to form an a priori value. 

In one aspect of the invention an apparatus for parallel decoding of modulo N turbo 
encoded data is disclosed. The apparatus includes means for accepting samples of modulo N 
turbo encoded data representing a block of turbo encoded data, means for calculating metrics 
metric that accepts samples of modulo N turbo encoded data from the sample accepting 
20 means and calculates the metric values for each sample, N means for accepting a soft input 

and producing a soft output (SISO means) that accept the metric values and an a priori values 
and produce an extrinsic value and N modulo N deinterleaving means that accept an extrinsic 
value and deinterleave it to form an a priori value. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

The features, aspects, and advantages of the present invention which have been 
described in the above summary will be better understood with regard to the following 
description, appended claims, and accompanying drawings where: 

Figure 1 is a graphical illustration of an environment in which embodiments of the 
30 present invention may operate. 

Figure 2 is a block diagram of a portion of a signal encoder according to an 
embodiment of the invention. 

Figure 3 is a block diagram of a parallel concatenated (turbo) encoder, illustrating the 
difference between systematic and nonsystematic forms. 
35 Figure 4 is a schematic diagram of a rate 2/3 "feed forward" convolutional 

nonsystematic encoder. 
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1 Figure 5 is a schematic diagram of a rate 2/3 "recursive" convolutional nonsystematic 

encoder. 

Figure 6 is a trellis diagram of the convolutional encoder illustrated in Figure 5. 

Figure 7 is a block diagram of a turbo-trellis coded modulation (TTCM) encoder. 
5 Figure 8A is a block diagram of a TTCM encoder utilizing multiple interleaves. 

Figure 8B is a graphical illustration of the process of modulo interleaving. 

Figure 8C is a further graphical illustration of the process of modulo interleaving. 

Figure 9 is a block diagram of a TTCM encoder employing a tuple interleaver. 

Figure 10 is a block diagram of a TTCM encoder employing a bit interleaver. 
1 0 Figure 1 1 A is a first portion of combination block diagram and graphical illustration of 

a rate 2/3 TTCM encoder employing a ST interleaver, according to an embodiment of the 
invention. 

Figure 1 IB is a second portion of combination block diagram and graphical illustration 
of a rate 2/3 TTCM encoder employing a ST interleaver, according to an embodiment of the 
1 5 invention. 

Figure 12 is a combination block diagram and graphical illustration of rate Vz parallel 
concatenated encoder (PCE) employing a modulo-N Interleaver. 

Figure 13 is a graphical illustration of the functioning of a modulo-4 ST interleaver, 
according to an embodiment of the invention. 
20 Figure 14A is a graphical illustration of the generation of interleaver sequences from a 

seed interleaving sequence. 

Figure 14B is a graphical illustration of a process by which modulo-2 and modulo-3 
interleaving sequences may be generated. 

Figure 14C is a graphical illustration of a process by which a modulo-4 interleaving 
25 sequence may be generated.. 

Figure 15 is a graphical illustration of trellis encoding. 

Figure 16 is a graphical illustration of Turbo Trellis Coded Modulation (TTCM) 
encoding. 

Figure 17 is a graphical illustration of a rate 2/3 TTCM encoder according to an 
30 embodiment of the invention. 

Figure 1 8 A is a graphical illustration of a rate Vz TTCM encoder, with constituent 2/3 
rate encoders, according to an embodiment of the invention. 

Figure 18B is a graphical illustration of alternate configurations of the rate Vz TTCM 
encoder illustrated in Figure 18 A. 
35 Figure 18C is a graphical illustration of alternate configurations of the rate Vz TTCM 

encoder illustrated in Figure 18 A. 
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Figure 18D is a graphical illustration of alternate configurations of the rate X A TTCM 
encoder illustrated in Figure 1 8 A. 

Figure 18E is a graphical illustration of alternate configurations of the rate l A TTCM 
encoder illustrated in Figure 18 A. 

Figure 19 is a graphical illustration of a rate 3/4 TTCM encoder, with constituent 2/3 
rate encoders, according to an embodiment of the invention. 

Figure 20A is a graphical illustration of a rate 5/6 TTCM encoder, with constituent 2/3 
rate encoders, according to an embodiment of the invention. 

Figure 20B is a graphical illustration which represents an alternate encoding that will 
yield the same coding rate as Figure 20A. 

Figure 21 A is a graphical illustration of a rate 8/9 TTCM encoder, with constituent 2/3 
rate encoders, according to an embodiment of the invention. 

Figure 2 IB is a graphical illustration which represents an alternate encoding that will 
yield the same coding rate as Figure 21 A 

Figure 22 is a graphical illustration of map 0 according to an embodiment of the 
invention. 

Figure 23 is a graphical illustration of map 1 according to an embodiment of the 
invention. 

Figure 24 is a graphical illustration of map 2 according to an embodiment of the 
invention. 

Figure 25 is a graphical illustration of map 3 according to an embodiment of the 
invention. 

Figure 26 is a block diagram of a modulo-2 (even/odd) TTCM decoder according to an 
embodiment of the invention. 

Figure 27 is a TTCM modulo-4 decoder according to an embodiment of the invention. 

Figure 28 is a graphical illustration of a modulo-N encoder/decoder system according 
to an embodiment of the invention. 

Figure 29 is a graphical illustration of the output of the TTCM encoder illustrated in 
Figure 17. 

Figure 30 is a graphical illustration of the tuple types produced by the TTCM encoder 
illustrated in Figure 18 A. 

Figure 31 is a graphical illustration illustrating the tuple types produced by the rate 3/4 
encoders of Figure 19. 

Figure 32 is a graphical illustration of the tuple types produced by the rate 5/6 encoder 
illustrated in Figure 20A. 

Figure 33 is a chart defining the types of outputs produced by the 8/9th encoder 
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1 illustrated in Figure 2 1 A. 

Figure 34 is a further graphical illustration of a portion of the decoder illustrated in 
Figure 26. 

Figure 35 is a graphical illustration of the process carried on within the metric 
5 calculator of the decoder. 

Figure 36 is a graphical illustration of the calculation of a Euclidean squared distance 

metric. 

Figure 37 is a representation of a portion of a trellis diagram as may be present in 
either SISO 2606 or SISO 2608. 
1 0 Figure 38 is a generalized illustration of a forward state metric alpha and a reverse 

state metric beta. 

Figure 39A is a block diagram foldei illustrating the parallel SISO coupling illustrated 
in Figure 26. 

Figure 39B is a block diagram of a modulo-N type decoder. 
1 5 Figure 40 is a block diagram illustrating the workings of a SISO such as that illustrated 

at 3901, 3957, 2606 or 2701. 

Figure 41 is a graphical representation of the processing of alpha values within a SISO 
such as illustrated at 3901 , 4000 or 2606. 

Figure 42 is a graphical illustration of the alpha processing within the SISO 4000. 
20 Figure 43 is a block diagram further illustrating the read-write architecture of the 

decoder as illustrated in Figure 2606. 

Figure 44 is a graphical illustration illustrating the generation of decoder sequences. 

Figure 45 is a graphical illustration of a decoder trellis according to an embodiment of 
the invention. 

25 Figure 46A is a graphical illustration of a method for applying the Min* operation to 

four different values. 

Figure 46B is a graphical illustration further illustrating the use of the Min* operation. 
Figure 47 is a graphical illustration of two methods of performing electronic addition. 
Figure 48A is a block diagram in which a carry sum adder is added to a Min* circuit 
30 according to an embodiment of the invention. 

Figure 48B is a block diagram in which a carry sum adder is added to a Min* circuit 
according to an embodiment of the invention. 

Figure 49 is a graphical illustration of Min* calculation. 

Figure 50A is a graphical illustration of the computation of the log portion of the Min* 
35 operation assuming that A is positive, as well as negative. 

Figure SOB is a graphical illustration of the computation of the log portion of the Min* 
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1 operation, a variation of Figure 50 A assuming that A is positive, as well as negative. 

Figure 51 is a graphical illustration of a Min* circuit according to an embodiment of 
the invention. 

Figure 51A is a graphical illustration of the table used by the log saturation block of 
5 Figure 51. 

Figure 5 IB is a graphical illustration of a simplified version of the table of Figure 51 A. 
Figure 52A is a graphical illustration and circuit diagram indicating a way in which 
alpha values within a SISO may be normalized. 

Figure 52B is a graphical illustration and circuit diagram indicating an alternate way in 
1 0 which alpha values within a SISO may be normalized. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

Figure 1 is a graphic illustration of an environment in which embodiments of the 
present invention may operate. The environment illustrated at 101 is an information 

1 5 distribution system, such as may be found in a cable television distribution system. 

In Figure 1 data is provided to the system from an information source 103. For 
purposes of illustration, the information source displayed in Figure 1 may be considered to be 
a cable television system head end which provides video data to end users. A formatter 105 
accepts data from the information source 103. The data provided by information source 103 

20 may comprise analog or digital signals such as (but not limited to) video signals, audio 
signals, and data signals. The formatter block 105 accepts the data from the information 
source and formats it into an appropriate form, such as message tuples, which are illustrated 
at 107. The formatted data is then provided to a channel encoder 109. Channel encoder 109 
encodes that data provided to it. In some embodiments of the present invention, the channel 

25 encoder 109 may provide an encoding, with different goals depending on the particular 

implementation, for example to make the signal more robust, to reduce the error probability, 
to operate the system using less transmission power or to enable a more efficient decoding of 
the signal. Channel encoder 1 09 then provides the encoded data to a transmitter 111. The 
transmitter transmits the encoded data provided to it by the channel encoder 109, for example, 

30 using an antenna 113. The signal broadcast from antenna 1 1 3 is received by a relay satellite 
1 15 and then rebroadcast to a receiving terrestrial antenna, such as earth station antenna 117. 
Earth station antenna 117 collects the satellite signal and provides the collected signal to a 
receiver 119. The receiver 119 will amplify and demodulate/detect the signal as appropriate 
and provide the detected signal to a decoder 121. Decoder 121 will essentially, reverse the 

35 process of the channel encoder 109 and recreate the message tuples 123, which should 

represent a good estimate of the message tuples 107 that had been broadcast. The decoder 
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1 121 may use Forward Error Correction (FEC), in order to correct errors in the received signal. 
The tuples 123 provided by the decoder are then provided to a formatting unit 125, which 
prepares the received message tuples for use by an information sink, such as the television 
display illustrated at 127. 

5 Figure 2 is a block diagram of a portion of a signal encoder according to an 

embodiment of the invention. In Figure 2 message tuples 107 are provided to channel 
encoder 109. Channel encoder 109 comprises a Reed-Solomon unit 201, which provides a 
first encoding of the message tuples 107. The output of the Reed-Solomon (RS) unit 201 
which includes a RS encoder and may include an interleaver is then provided a turbo trellis- 

1 0 coded modulation (TTCM) encoder 208 . The output of the Reed-Solomon unit 201 is then 
provided to a turbo encoder 203, which applies a parallel concatenated (turbo) encoding to the 
input received from the Reed-Solomon unit 201, and further provides it to a mapper 205. In 
addition, some of the bits of the data output from the Reed-Solomon unit 201 may bypass the 
turbo encoder 203 entirely and be coupled directly into the mapper 205. Such data bits which 

1 5 bypasses the turbo encoder 203 are commonly referred to as uncoded bits. The uncoded bits 
are taken into account in the mapper 205 but are never actually encoded in the turbo encoder 
203. In some embodiments of the invention there are no uncoded bits. In other embodiments 
of the invention there may be several uncoded bits depending on the data rate of the overall 
turbo trellis-coded modulation (TTCM) encoder desired. The output of the Reed-Solomon 

20 unit 201 may vary in form depending on the overall rate desired from the TTCM encoder 208 
. Turbo encoders, such as that illustrated at 203, may have a variety of forms and 
classifications. One of the classifications of encoders in general and turbo encoders in 
particular is illustrated in Figure 3. 

Figure 3 is a block diagram of a parallel concatenated encoder illustrating the 

25 difference between systematic and nonsystematic forms. In Figure 3 data is input into the 
circuit at 301 . Data is output from the parallel concatenated encoder (PCE) circuit 300 at 
303. The data output 303 of the PCE illustrated at 300 may reach the output via three 
different paths. Input data tuples (groups of one or more bits) may be received at 301 and 
coupled directly to the data output 303 through selector mechanism 305 along the path 

30 labeled D. The data input may also be coupled into a first encoder 307 where it will be 

encoded and then coupled along the path E, through selector 305 and into data output 303. 
The data accepted into the PCE circuit at 301 may also be provided to an interleaver 309. 
Interleaver 309 rearranges the input sequence of the data accepted by the PCE circuit at 301. 
In other words, the interleaver shuffles the order of the data so that the data out of the 

35 interleaver 309 is not the same order as the data into the interleaver 309. The data out of the 
interleaver 309 is then provided to a second encoder 311. The second encoder 311 encodes 
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the data provided to it by the interleaver 309 and then provides the encoded data along path R, 
through the selector 305 into the data output 303. If the selector 305 selects the data from 
path D and E 1 and E2, where D represents all of the input data tuple, then a systematic-type 
turbo encoding is performed. However, if the data selector selects only between path E, and 
E2, such that there is no direct path between the data input and data output, a nonsystematic 
turbo encoding is performed. In general the data input at 301 comprises input data tuples 
which are to be encoded. The data output at 303 comprises code words, which are the 
encoded representation of the input data tuples. In general, in a systematic type of encoding, 
the input tuples are used as part of the output code words to which they correspond. Within 
parallel concatenated encoders, such as that illustrated at 300, encoders such as the first 
encoder 307 and second encoder 31 1 are commonly referred to as component or constituent 
encoders because they provide encoding, which are used as components of the overall turbo 
encoding. The first encoder 307 and the second encoder 311 may also have a variety of forms 
and may be of a variety of types. For example, the first encoder 307 may be a block encoder 
or a convolutional-type encoder. Additionally, the second encoder 3 1 1 may also be a block or 
convolutional-type encoder. The first and second encoders themselves may also be of 
systematic or nonsystematic form. The types of encoders may be mixed and matched so that, 
for example, the first encoder 307 may comprise a nonsystematic encoder and second encoder 
3 1 1 may comprise a systematic-type encoder. 

Constituent encoders, such as first encoder 307 and second encoder 311 may have 
delays incorporated within them. The delays within the encoders may be multiple clock 
period delays so that the data input to the encoder is operated on for several encoder clock 
cycles before the corresponding encoding appears at the output of the encoder. 

One of the forms of a constituent encoder is illustrated in Figure 4. 

Figure 4 is a schematic diagram of a rate two-thirds feed forward nonsystematic 
convolutional encoder. The encoder illustrated at 400 in Figure 4 is a rate two-thirds because 
there are two inputs 401 and 403 and three outputs 405, 407 and 409. Accordingly, for each 
input tuple comprising two input bits 401 and 403, which are accepted by the encoder 400, 
the output is a code word having three bits 405, 407 and 409. Therefore, for each two bits 
input at inputs 401 and 403 three bits are output at 405, 407 and 409. The encoder of 
Figure 4 comprises three delays 417, 419 and 421. Such delays may be formed from D-type 
flip flops or any other suitable delay or storage element. The rate two-thirds feed forward 
encoder of Figure 4 also comprises five modulo-2 adders 411, 413, 415, 423 and 425. 
Modulo-2 adders are adders in which the outputs of the modulo-2 adder is equal to the 
modulo-2 sum of the inputs. Delay elements 417, 419 and 421 are clocked by an encoder 
clock. Modulo-2 adders 41 1, 413, 415, 423 and 425 are combinational circuits which are 
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1 unclocked. In combinational circuits the output appears a time delay after the inputs are 
changed. This time delay is due to the propagation time of the signal within the 
combinational circuits (this delay is assumed as a near zero delay herein) and not due to any 
clocking mechanisms. In contrast, a delay unit, such as 417, will not change its output until it 

5 receives an appropriate clock signal. Therefore, for an input signal to propagate, for example 
from input 403 through modulo-2 adder 41 1, through delay 417, through modulo-2 adder 413, 
through delay 419, through modulo-2 adder 415, through delay 421 in order to appear at 
output 409, the encoder clock 427 must first clock the input signal from 403 through delay 
unit 417, then through delay unit 419, and finally through delay unit 421. Therefore, once an 

1 0 input signal appears at 403 three encoder clocks 427 in succession will be required for the 
resultant output 409, which is associated with that input at 403, to be seen at the output. 

The encoder of Figure 4 is a feed forward encoder. The signal is always fed forward 
and at no point in the circuit is there a path to feed back a signal from an later stage to an 
earlier stage. As a consequence a feed forward encoder, such as that illustrated in Figure 4, is 

15 a finite impulse response (FIR) type of state machine. That is, for an impulse signal applied 
at the input, the output will eventually settle into a stable state. 

The encoder illustrated in Figure 4 may further be classified as a nonsystematic 
encoder because none of the inputs, that is either 401 or 403, appear at the output of the 
encoder. That is outputs 405, 407 or 409 don't reproduce the inputs in an encoded output 

20 associated with that input. This can be inferred from the fact that output 407, 405 and 409 
have no direct connection to inputs 40 1 or 403 . 

Figure 5 is a schematic diagram of a rate two-thirds, recursive, convolutional 
nonsystematic encoder. The encoder of Figure 5 is similar to the encoder of Figure 4 in that 
both encoders are nonsystematic and convolutional. The encoder of Figure 5 is the same 

25 schematically as the encoder of Figure 4 with the addition of a third input at modulo-2 adder 
5 1 1 and a third input at modulo-2 adder 515. The third input for each of modulo-2 adders 
511 and 515 is formed by an additional modulo-2 adder 527. Modulo-2 adder 527 is formed 
in part by the output of delay 52 1 . Modulo-2 adder 527 receives an input from delay 52 1 
which is provided to modulo-2 adders 511 and 515. Accordingly the encoder of Figure 5 is 

30 recursive. In other words, the inputs of delays 517 and 521 are partially formed from outputs 
occurring later in the signal path and fed back to an earlier stage in the circuit. Recursive 
encoders may exhibit outputs that change when repeatedly clocked even when the inputs are 
held constant. The encoder of Figure 5 is a constituent encoder, and is used with an 
embodiment of the invention as will be described later. 

35 Figure 6 is a trellis diagram for the encoder illustrated in Figure 5. A trellis diagram is 

a shorthand method of defining the behavior of a finite state machine such as the basic 
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1 constituent encoder illustrated in Figure 5. The state values in Figure 6 represent the state of 
the encoder. As can be seen from the trellis diagram in Figure 6, when the encoder of 
Figure 5 is in any single state, it may transition to any one of four different states. It may 
transition to four different states because there are two inputs to the encoder of Figure 5 

5 resulting in four different possible input combinations which cause transitions. If there had 
been only one input to the encoder of Figure 5, for example, if inputs 501 and 503 were 
connected, then each state in the trellis diagram would have two possible transitions. As 
illustrated in the trellis diagram in Figure 6, if the encoder is in state 0, state 1, state 2 or state 
3, the encoder may then transition into state 0, state 2, state 4 or state 6. However, if the 

1 0 encoder is in state 4, state 5, state 6 or state 7, it may transition into state 1, state 3, state 5 or 
state 7. 

Figure 7 is a block diagram of a turbo trellis-coded modulation (TTCM) encoder. In 
Figure 7 an input data sequence 701 is provided to an "odd" convolutional encoder 703 and 
an interleaver 705. The interleaver 705 interleaves the input data sequence 701 and then 

1 5 provides the resulting interleaved sequence to "even" convolutional encoder 707. Encoders 
703 and 707 are termed "odd" and "even" respectively because encodings corresponding to 
odd input tuples (i.e. input tuple no. 1, 3, 5, etc.) are selected by selector 709 from encoder 
703 and encodings corresponding to even input tuples (i.e. input tuple no. 0, 2, 4, etc.) are 
selected by selector 709 from encoder 707. The output of either the odd convolutional 

20 encoder 703 or the even convolutional encoder 707 is selected by a selecting mechanism 709 
and then passed to a mapper 710. Figure 7 is a generalized diagram according to an 
embodiment of the invention which illustrates a general arrangement for a TTCM encoder. 
The odd convolutional encoder 703 receives the input data sequence and, in an embodiment 
of the invention, convolutionally, nonsystematically, encodes the input data sequence. Even 

25 convolutional encoder 707 receives the same input data as the odd convolutional encoder, 
except that the interleaver 705 has rearranged the order of the data. The odd and even 
convolutional encoders may be the same encoders, different encoders or even different types 
of encoders. For example, the odd convolutional encoder may be a nonsystematic encoder, 
whereas the even convolutional encoder may be a systematic encoder. In fact the 

30 convolutional encoders 703 and 707 may be replaced by block-type encoders such as 

Hamming encoders or other block-type encoders well known in the art. For the purposes of 
illustration, both constituent encoders 703 and 707 are depicted as nonsystematic, 
convolutional, recursive encoders as illustrated in Figure 5 . The select mechanism 709 
selects, from convolutional encoder 703, outputs corresponding to odd tuples of the input data 

35 sequence 701. The select mechanism 709 selects, from convolutional encoder 707, outputs 
which correspond to even tuples of the input data sequence 701 . Select mechanism 709 
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1 alternates in selecting symbols from the odd convolutional encoder 703 and the even 

convolutional encoder 707. The selector 709 provides the selected symbols to the mapper 
710. The mapper 710 then maps the output of either the even convolutional encoder 707 or 
the odd convolutional coder 703 into a data constellation (not shown). In order to maintain a 

5 sequence made up of distance segments stemming from the even and odd input tuples, the 
selector 709 selects only encodings corresponding to even tuples of the input data sequence 
701 from one encoder (e.g. 703), and selects only encoding corresponding to odd tuples of the 
input data sequence from the other encoder (e.g. 707). This can be accomplished by 
synchronizing the selection of encoded tuples from the odd (703) and even (707) encoders, 

10 for example using a clock 711, and by using an odd/even interleaver 705 to maintain an 

even/odd ordering of input data tuples to the even encoder 707. The odd/even interleaver 705 
will be described in detail later. 

The encoder illustrated in Figure 7 is a type which will be known herein as a turbo 
trellis-coded modulation (TTCM) encoder. The interleaver 705, odd convolutional encoder 

1 5 703, even convolutional encoder 707 and selector form a turbo encoder, also known as a 
parallel concatenated encoder (PCE). The encoder is known as a parallel concatenated 
encoder because two codings are carried on in parallel. For the parallel encoding, in the 
Figure 7 example one coding takes place in the odd convolutional encoder 703, and the other 
takes place in the even convolutional encoder 707. An output is selected sequentially from 

20 each encoder and the outputs are concatenated to form the output data stream. The mapper 
.710 shown in Figure 7 provides the trellis coded modulation (TCM) function. Hence, the 
addition of the mapper makes the encoder a turbo trellis-type encoder. As shown in Figure 7, 
the encoders may have any number of bits in the input data tuple. It is the topology that 
defines the encoder-type. 

25 The encoder of Figure 7 is an illustration of only one of the possible configurations 

that may form embodiments of the present invention. For example, more than one interleaver 
may be employed, as shown in Figure 8. 

Figure 8A is a block diagram of a TTCM encoder using multiple interleaves. 
Figure 8A illustrates an exemplary embodiment of the present invention utilizing N 

30 interleaves. 

The first interleaver 802 is called the null interleaver or interleaver 1 . Generally in 
embodiments of the invention the null interleaver will be as shown in Figure 8 A, that is a 
straight through connection, i e. a null interleaver. All interleaving in a system will be with 
respect to the null sequence produced by the null interleaver. In the case where the null 
35 interleaver is merely a straight through connection the null sequence out of the null 
interleaver will be the same as the input sequence. The concept of null interleaver is 
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1 introduced as a matter of convenience, since embodiments of the invention may or may not 
have a first interleaver a convenient way to distinguish is to say "where the first interleaver is 
the null interleaver" when the first encoder receives input tuples directly and to say "where the 
first interleaver is an ST interleaver", when an ST interleaver occupies a position proximal to 

5 a first encoder. 

In Figure 8 A source input tuples 801 are provided to encoder 811 and to interleaves 
802 through 809. There are N interleavers counting the null interleaver as interleaver No. 1 
and N encoders present in the illustration in Figure 8 A. Other embodiments may additionally 
add an ST interleaver as interleaver No. 1 to process input tuples 801 prior to providing them 

10 to encoder 811. 

Source tuples T 0 , T, and T 2 are shown as three bit tuples for illustrative purposes. 
However, those skilled in the art will know that embodiments of the invention can be realized 
with a varying number of input bits in the tuples provided to the encoders. The number of 
input bits and rates of encoders 8 1 1 through 8 1 9 are implementation details and may be 

1 5 varied according to implementation needs without departing from scope and spirit of the 
invention. 

Interleavers 803 through 809 in Figure 8A each receive the same source data symbols 
801 and produce interleaved sequences 827 through 833. Interleaved sequences 827 through 
833 are further coupled into encoders 813 through 819. Select mechanism 821 selects an 

20 encoded output from encoders 811 through 819. Selector 821 selects from each encoder 811 
through 819 in sequence so that one encoded tuple is selected from each encoder in one of 
every N+l selections. That is the selection number 0 (encoded tuple / 0 ) is chosen from 
encoder 811, the selection number 1 (encoded tuple w, is chosen from encoder 813 V 2 is 
chosen from encoder 815, and so forth. The same selection sequence is then repeated by 

25 selector 821. 

In order not to miss any symbols, each interleaver is a modulo-type interleaver. To 
understand the meaning of the term modulo interleaver, one can consider the interleaver of 
Figure 7 as a modulo-2 interleaver. The interleaver of Figure 7 is considered a modulo^2 
interleaver because input tuples provided to the interleaver during odd times (i.e. provided as 

30 input tuple 1,3,5 etc.) will be interleaved into odd time positions at the output of the 

interleaver (e.g. output tuple 77, 105, 321 etc.) That is the first tuple provided by an odd/even 
interleaver may be the third, fifth, seventh, etc. tuple provided from the interleaver, but not 
the second, fourth, sixth, etc. The result of any modulo-2 operation will either be a 0 or a 1, 
that is even or odd respectively, therefore the interleaver of Figure 7 is termed a modulo-2 or 

35 odd/even interleaver. In general, according to embodiments of the invention, the value of N 
for a modulo-N interleaving system is equal to the number of interleavers counting the Null 
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1 interleaver as the first interleaver in the case where there is no actual first interleaves The 
modulo interleaving system of Figure 8A is modulo-N because there are N interleaves, 
including null interleaver 1, interleaving system. The interleaves in a modulo interleaver 
system may interleave randomly, S randomly, using a block interleaver, or using any other 

5 mechanism for interleaving known in the art, with the additional restriction that input/output 
positional integrity be maintained. When a sequence of tuples is interleaved, the modulo 
position value of an output will be the same as the modulo positional value of the input tuple. 
The position of a tuple modulo-N is known as a sequence designation, modulo designation, or 
modulo sequence designation. For example, in a modulo-4 interleaver the first tuple 

1 0 provided to the interleaver occupies position 0 of the input tuple stream. Because 0 modulo-4 
is zero the modulo sequence designation of the first input tuple is 0 . The tuple occupying the 
position 0 may then be interleaved to a new output position #4, #8, #12, #16, etc., which also 
have the same modulo sequence designation, i.e. 0. The tuples occupying output position #4, 
#8, #12, #16 all have a sequence designation of 0 because 4 mod 4 = 8 mod 4=12 mod 4 = 

15 16 mod 4 = 0. Similarly, the input tuple occupying position 2 and having sequence 

designation of 2 may be interleaved to a new output position #6, #10, #14, #20, etc, which 
also have the same modulo sequence designation of 2. The tuples in output positions #6, #10, 
#14, #20 etc have a modulo sequence designation of 2 because 6 mod 4=10 mod 4 = 14 mod 

4 = 20 mod 4 = 2. 

20 For example, in Figure 7 the modulo-2 interleaver 705, also known as an odd/even 

interleaver, may employ any type of interleaving scheme desired with the one caveat that the 
input data sequence is interleaved so that each odd sequence input to the interleaver is 
interleaved into another odd sequence at the output of the interleaver. Therefore, although 
interleaver 705 may be a random interleaver, it cannot interleave the inputs randomly to any 

25 output. It can, however, interleave any odd input to any random odd output and interleave 
any even input into any random even interleaved output In embodiments of the present 
invention, a modulo interleaving system, such as that illustrated in Figure 8 A, the interleaves 
must maintain the modulo positi onal integrity of interleaved tuples. For example, if there are 

5 interleaves including the null interleaver (numbers 0-4) in Figure 8A, then Figure 8A 
30 would describe a modulo-5 interleaving system. In such a system, the input source data 

would be categorized by a modulo sequence number equal to the sequence position of the 
source data tuple modulo-5. Therefore, every input data tuple would have a sequence value 
assigned to it between 0 and 4 (modulo-5). In each of the 5 interleavers of the modulo-5 
system, source data elements (characterized using modulo numbers) could be interleaved in 
35 any fashion, as long as they were interleaved into an output data tuple having an output 
sequence modulo number designation equal to the input sequence modulo number 
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1 designation. The terms modulo sequence number sequence designation, modulo position 
value modulo designation, modulo position all refer to the same modulo ordering. 

In other words an interleaver is a device that rearranges items in a sequence. The 
sequence is input in a certain order. An interleaver receives the items form the input 

5 sequence, I, in the order I 0 , I„ I 2 , etc., I 0 being the first item received, I, being the second item 
received, item I 2 being the third item received. Performing a modulo-N operation on the 
subscript of I yields, the modulo-N position value of each input item. For example, if N=2 
modulo-N position I 0 - Mod 2 (0) = 0 i.e. even, modulo-N position I, = Mod 2 (l) = 1 i.e., odd, 
modulo-N position I 2 = Mod 2 (2) = 0 i.e. even. 

1 0 Figure 8B is a graphical illustration of examples of modulo interleaving. Interleaving 

is a process by which input data tuples are mapped to output data tuples. 

Figure 8B illustrates of the process of modulo interleaving. As previously stated for 
the purposes of this disclosure an interleaver is defined as a device having one input and one 
output that receives a sequence of tuples and produces an output sequence having the same bit 

1 5 components as the input sequence except for order. That is, if the input sequence contains X 
bits having values of one, and Y bits having values of zero then the output sequence will also 
have X bits having values of 1 and Y bits having values of zero. An interleaver may reorder 
the input tuples or reorder the components of the input tuples or a combination of both. In 
embodiments of the invention the input and output tuples of an interleaver are assigned a 

20 modulo sequence designation which is the result of a modulo division of the input or output 
number of a tuple. That is, each input tuple is assigned a sequence identifier depending on 
the order in which it is accepted by the interleaver, and each output tuple is assigned a 
sequence identifier depending on the order in which it appears at the output of the interleaver. 

25 For example, in the case of a modulo-2 interleaver the sequence designation may be 

even and odd tuples as illustrated at 850 in Figure 8B. In such an example, the input tuple in 
the 0 position, indicating that it was the first tuple provided, is designated as an even tuple T 0 . 
Tuple T u which is provided after tuple T 0 is designated as an odd tuple, tuple T 2 , which is 
provided after T, is designated as an even tuple and so forth. The result of the modulo 

30 interleaving is illustrated at 852. The input tuples received in order T 0 , T„ T 2 , T 3 , T 5 , T 6 have 
been reordered to T 2 , T 3 , T 6 , T 5 , T 0 , T„ T 4 . Along with the reordered tuples at 852 is the new 
designation Iq through I 6 which illustrates the modulo sequence position of the interleaved 
tuples. 

The modulo-2 type interleaver illustrated in figure 8B at 854 can be any type of 
35 interleaver, for example, a block interleaver, a shuffle interleaver or any other type of 
interleaver known in the art if it satisfies the additional constraint that input tuples are 
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1 interleaved to positions in the output sequence that have the modulo position value. 
Therefore an input tuple having an even modulo sequence designation will always be 
interleaved to an output tuple having an even modulo sequence designation and never will be 
interleaved to an output tuple having an odd modulo sequence designation. A modulo-3 

5 interieaver 856 will function similarly to a moduIo-2 interleaver 854 except that the modulo 
sequence designation will not be even and odd but zero, one and two. The sequence 
designation is formed by taking the modulo-3 value of the input position (beginning with 
input position 0. Referring to Figure 8B modulo-3 interleaver 856 accepts input sequence T 0 , 
T„ T 2 , T 3 , T 4 , T 5 and T 6 (858) and interleaves it to interleaved sequence 860: T 3 , T 4 , T 5 , T 6 , 

10 T l9 T 2 which are also designated as interleaved tuples I 0 through 1$. 

As a further illustration of modulo interleaving, a modulo-8 interleaver is illustrated at 
862. The modulo 8 interleaver at 862 takes an input sequence illustrated at 864 and produces 
an output sequence illustrated at 866. The input sequence is given the modulo sequence 
designations of 0 through 7 which is the input tuple number modulo-8. Similarly, the 

1 5 interleaved sequence is given a modulo sequence designation equal to the interleaved tuple 
number modulo-8 and reordered compared to the input sequence under the constraint that the 
new position of each output tuple has the same modulo-8 sequence designation value as its 
corresponding input tuple. 

In summary, a modulo interleaver accepts a sequence of input tuples which has a 

20 modulo sequence designation equal to the input tuple number modulo-N where N - H of the 
interleaver counting the null interleaver. The modulo interleaver then produces an interleaved 
sequence which also has a sequence designation equal to the interleaved tuple number divided 
by the modulo of the interleaver. In a modulo interleaver bits which start out in an input tuple 
with a certain sequence designation must end up in an interleaved modulo designation in 

25 embodiments of the present invention. Each of the N interleaves in a modulo N interleaving 
system would provide for the permuting of tuples in a manner similar to the examples in 
Figure 86; however, each (interleaver would yield a different permutation. 

The input tuple of an interleaver, can have any number of bits including a single bit. In 
the case where a single bit is designated as the input tuple, the modulo interleaver may be 

30 called a bit interleaver. 

Inputs to interleaves may also be arbitrarily divided into tuples. For example, if 4 bits 
are input to in interleaver at a time then the 4 bits may be regarded as a single input tuple, two 
2 bit input tuples or four 1 bit input tuples. For the purposes of clarity of the present 
application if 4 bits are input into an interleaver the 4 bits are generally considered to be a 

35 single input tuple of 4 bits. The 4 bits however may also be considered to be l A of an 8 bit 

input tuple, two 2 bit input tuples or four 1 bit input tuples the principles described herein. If 
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all input bits input to the interleaver are kept together and interleaved then the modulo 
interleaver is designated a tuple interleaver (a.k,a. integral tuple interleaver) because the input 
bits are interleaved as a single tuple. The input bits may be also interleaved as separate 
tuples. Additionally, a hybrid scheme may be implimented in which the input tuples are 
interleaved as tuples to their appropriate sequence positions, but additionally the bits of the 
input tuples are interleaved separately. This hybrid scheme has been designated as an ST 
interleaver. In an ST interleaver, input tuples with a given modulo sequence designation are 
still interleaved to interleaved tuples of similar sequence designations. Additionally, 
however, the individual bits of the input tuple may be separated and interleaved into different 
interleaved tuples (the interleaved tuples must all have the same modulo sequence designation 
as the input tuple from which the interleaved tuple bits were obtained). The concepts of a 
tuple modulo interleaver, a bit modulo interleaver, and a bit-tuple modulo interleaver are 
illustrated in the following drawings. 

Figure 9 is a block diagram of TTCM encoder employing a tuple type interleaver. In 
Figure 9 an exemplary input data sequence 901 comprises a sequence of data tuples T 0 , T„ T 2 , 
T 3 and T 4 . The tuples are provided in an order such that T 0 is provided first, Tj is provided 
second, etc. Interleaver 915 interleaves data sequence 901. The output of the interleaver 
comprises a new data sequence of the same input tuples but in different order. The data 
sequence 903, after interleaving, comprises the data tuples T 4 , T 3 , T 0 , T, and T 2 in that order. 
The tuple interleaver illustrated in Figure 9 at 915 is a modulo-2 or odd/even type interleaver. 
The original data sequence 901 is provided to odd convolutional encoder 905 and the 
interleaved data sequence 903 is provided to an even convolutional encoder 907. A select 
mechanism 909 selects encoded outputs from the odd convolutional encoder 905 and the even 
convolutional encoder 907, according to the procedure provided below and illustrated in 
Figure 9, and provides the encoder output selected to the mapper 911. The select mechanism 
909 illustratively chooses encoded outputs from the "odd" convolutional encoder 905 that 
correspond to odd tuples in the input data sequence 901 . The select device 909 also chooses 
encoded tuples from the even convolutional encoder 907, that correspond to the even tuples 
of input sequence 903. So if the odd convolutional encoder 905 produces encoded tuples O 0 , 
0„ 0 2 , 0 3 and 0 4 corresponding to the input sequence of data tuples 901, the selector will 
select O, and 0 3 (which have an odd modulo sequence designation) to pass through the 
mapper. In like manner if the even convolutional encoder produces symbols E 4 , E3, E 0 , E, and 
E 2 from the input sequence 903 and select mechanism 909 selects E 4 , E 0 and Ej and passes 
those encoded tuples to the mapper 911. The mapper will then receive a composite data 
stream corresponding to encoded outputs E 4 , 0„ E 0 , 0 3 , and E^. In this manner an encoded 
version of each of the input data sequence tuples 901 is passed onto the mapper 91 1. 
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1 Accordingly, all of the input data sequence tuples 901 are represented in encoded form in the 
data 913 which is passed onto the mapper 911. Although both encoders encode every input 
tuple, the encoded tuples having an odd sequence designation are selected from encoder 905 
and the encoded tuples having an even sequence designation are selected from encoder 907. 

5 In the interleaver 915 of Figure 9, each tuple is maintained as an integral tuple and there is no 
dividing of the bits which form the tuple. A contrasting situation is illustrated in Figure 10. 

Figure 10 is a block diagram of a TTCM encoder employing a bit type interleaver. In 
Figure 10 an input tuple is represented at 1003 as input bits i 0 through i k _,. The input bits i 0 
through i k _j are coupled into an upper constituent encoder of 1007. The input tuple 1003 is 

10 also coupled into interleaver 1005. The interleaver 1005 is further divided into interleaves 
1009, 101 1 and 1013. Each of the interleaves 1009, 101 1 and 1013 accepts a single bit of 
the input tuple. The input tuple 1003 is then rearranged in the interleaver 1005 such that each 
bit occupies a new position in the sequence that is coupled into the lower constituent encoder 
1015. The interleaving performed by the interleaver 1005 may be any type of suitable 

1 5 interleaving. For examples, the interleaver may be a block interleaver a modulo interleaver as 
previously described, or any other type of interleaver as known in the art. 

In the illustrated interleaver of Figure 10 the interleaving sequence provided by 
interleaver 1005, and hence by sub-interleavers 1009, 1011 and 1013, is independent of the 
positions of the bits within the input 1003. Input tuple 1001 represents input bits which are 

20 not passed through either of the constituent encoders 1007 or 1015. The upper encoding 1017 
comprises the uncoded input tuple 1001 plus the encoded version of input tuple 1003, which 
has been encoded in the upper constituent encoder 1007. The lower encoding 1019 comprises 
the uncoded input tuple 1001 plus the output of the lower constituent encoder 1015 which 
accepts the interleaved version of input tuple 1 003. A selector 1021 accepts either the upper 

25 or lower encoding and passes selected encoding to a symbol mapper 1 023. 

Figure 1 1 A is a first part of a combination block diagram and graphic illustration of a. 
rate 2/3 TTCM encoder employing a ST interleaver according to an embodiment of the 
invention. Figure 1 1 A and 1 IB in combination illustrate a modulo-2 ST interleaver as may 
be used with a rate 2/3 TTCM encoder. In Figure 1 1A input tuples 1 101 are provided to a 

30 rate 2/3 encoder 1 103. The rate 2/3 encoder 1 103 is designated as an even encoder because, 
although it will encode every input tuple, only the tuples corresponding to encoded even 
tuples will be selected from encoder 1 103 by the selection circuit. Input tuples comprise 2 
bits, a most significant bit designated by an M designation and a least significant bit 
designated by an L designation. The first tuple that will be accepted by the rate 2/3 even 

35 encoder 1 103 will be the even tuple 1 105. The even input tuple 1 105 comprises 2 bits where 
Mo is the most significant bit, and L 0 is the least significant bit. The second tuple to be 

-21- 



WO 02/23739 PCT/US01/28974 

1 accepted by the rate 2/3 even encoder 1 103 is the 1 107 tuple. The 1 107 tuple is designated as 
an odd tuple and comprises a most significant bit M { and a least significant bit L P The input 
tuples are designated even and odd because the interleaver 1 109, which is being illustrated in 
Figure 1 1 A, is modulo-2 interleaver also known as an even/odd interleaver. The same 

5 principles, however, apply to any modulo-N interleaver. If the modulo interleaver had been a 
mod 3 interleaver instead of a mod 2 interleaver then the input tuples would have sequence 
designations 0, 1 and 2. If the modulo interleaver had been a modulo-4 interleaver then the 
input tuples would have modulo sequence designations 0, 1, 2, 3. The modulo interleaving 
scheme, discussed here with respect to modulo-2 interleavers and 2 bit tuples, may be used 

1 0 with any size of input tuple as well as any modulo-N interleaver. Additionally, any rate 

encoder 1 103 and any type encoder may be used with the modulo ST interleaving scheme to 
be described. A rate 2/3 encoder, a modulo-2 ST interleaver, and 2 bit input tuples have been 
chosen for ease of illustration but are not intended to limit embodiments of the invention to 
the form disclosed. In other words, the following modulo-2 ST interleaver is chosen along 

1 5 with 2 bit input tuples and a rate 2/3 encoder system in order to provide for a relatively 
uncluttered illustration of the principles involved. The ST interleaver 1 109 in this case 
actually can be conceptualized as two separate bit type interleavers 1111 and 1113. The 
separation of the interleavers is done for conceptual type purposes in order to make the 
illustration of the concepts disclosed easier to follow. In an actual implementation the 

20 interleaver 1 109 may be implimented in a single circuit or multiple circuits depending on the 
needs of that particular implementation, Interleaver 1111 accepts the least significant bits of 
the input tuple pairs 1101. Note input tuple pairs designate input tuples having a pair, i.e. 
MSB and LSB, of bits. The interleaver 1111 interleaves the least significant bits of the input 
tuple pairs 1 101 and provides an interleaved sequence of least significant bits of the input 

25 tuple pairs for example those illustrated in 1 1 15. In the example, only eight input tuple pairs 
are depicted for illustration purposes. In an actual implementation the number of tuple pairs 
in a block to be interleaved could number tens of thousands or even more. Eight input tuple 
pairs are used for ease of illustration purposes. The least significant bits of the input tuple 
pairs 1 101 are accepted by the interleaver 1 1 1 1 in the order L 0 , L u L 2 , L 3 , L 4 , L 5 , L 6 , and L 7 . 

30 The interleaver, in the example of Figure 1 1 A, then provides an interleaved sequence 1 1 1 5 in 
which the least significant bits of the input tuples have been arranged in the order L 6 , L 5 , L 4 , 
L l5 L 2 , L 7 , L 0 and L 3 . Note that although the least significant bit of the input tuple pairs have 
been shuffled by the interleaver 1111 each least significant bit in an even tuple in the input 
tuple pairs is interleaved to an even interleaved position in the output sequence 1115. In like 

35 manner, odd least significant bits in the input sequence 1 101 are interleaved by interleaver 
1111 into odd position in the output sequence 1115. This is also a characteristic of modulo 
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1 ST interleaving. That is although the data input is interleaved, and the interleaving may be 
done by a variety of different interleaving schemes know in the art, the interleaving scheme, 
however, is modified such that even data elements are interleaved to even data elements and 
odd data elements are interleaved to odd data elements. In general, in modulo-N interleavers 

5 the data input to an interleaver would be interleaved to output positions having the same 

modulo sequence designation as the corresponding modulo sequence designation in the input 
sequence. That is, in a modulo-4 interleaver an input data element residing in a input tuple 
with a modulo sequence designation of 3 would end up residing in an interleaved output 
sequence with a modulo sequence designation of 3. In other words, no matter what type of 

1 0 interleaving scheme the interleaver (such as 1 1 1 1) uses, the modulo sequence designation of 
each bit of the input data tuples sequence is maintained in the output sequence. That is, 
although the positions of the input sequence tuples are changed the modulo interleaved 
positions are maintained throughout the process. This modulo sequence designation, here 
even and odd because a modulo-2 interleaver is being illustrated, will be used by the selection 

1 5 mechanism to select encoded tuples corresponding to the modulo sequence designation of the 
input tuples. In other words, the modulo sequence designation is maintained both through the 
interleavers and through the encoders. Of course, since the input tuples are encoded the 
encoded representation of the tuples appearing at the output of the encoder may be completely 
different and may have more bits than the input tuples accepted by the encoder. 

20 Similarly, the most significant bits of input tuples 1 101 are interleaved in interleaver 

1113. In the example of Figure 1 1 A, the sequence Mq through M 7 is interleaved into an 
output sequence M 2 , M 7 , M 0 , M 5 , M 3 , M 4 , and M,. The interleaved sequence 1 1 17, 
produced by interleaving the most significant bits of the input tuples 1 101 in interleaver 1113, 
along with the interleaved sequence of least significant bits 1 1 15 is provided to into the "odd" 

25 rate 2/3 encoder 1119. Note that in both cases all data bits are interleaved into new positions 
which have the same modulo sequence designation as the corresponding input tuples modulo 
sequence designation. 

Figure 1 IB is a second part of a combination block diagram and graphic illustration of 
a rate 2/3 TTCM encoder employing an ST interleaver. In Figure 1 IB the even rate 2/3 

30 encoder 1 103 and the odd rate 2/3 encoder 1 1 19, as well as the tuples input to the encoders, 
are reproduced for clarity. Even encoder 1 103 accepts the input tuple sequence 1101. The 
odd encoder 1119 accepts an input sequence of tuples, which is formed from the interleaved 
sequence of most significant bits 1117 combined with the interleaved sequence of least 
significant bits 1115. Both encoders 1 103 and 1 1 19 are illustrated as rate 2/3 nonsystematic 

35 convolutional encoders and therefore each have a 3 bit output. Encoder 1119 produces an 
output sequence 1153. Encoder 1 1 03 produces an output sequence 1151. Both sequences 
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1 1151 and 1 1 53 are shown in script form in order to indicate that they are encoded sequences. 
Both rate 2/3 encoders accept 2 bit input tuples and produce 3 bit output tuples. The encoded 
sequences of Figure 1 IB may appear to have 2 bit elements, but in fact the two letter 
designation and comprise 3 encoded bits each. Therefore, output tuple 1155 which is part of 

5 sequence 1 1 53 is a 3 bit tuple. The 3 bit tuple 1 155 however, is designated by a script M n and 
a script £ 5 indicating that that output tuple corresponds to an input tuple 1 160, which is 
formed from most significant bit M 7 and least significant bit L 5 . In like manner, output tuple 
1 157 of sequence 1151 comprises 3 bits. The designation of output tuple 1 157 as M 0 andJ 0 
indicates that that output tuple corresponds to the input tuple 1101, which is composed of 

1 0 input most significant bit Mq and input least significant bit L 0 . It is worthwhile to note that 

output tuple of encoder 1 103, which corresponds to input tuple 1161 maintains the same even 
designation as input tuple 1 161. In other words, the output tuple of an encoder in a modulo 
interleaving system maintains the same modulo sequence designation as the input tuple to 
which it corresponds. Additionally, in a ST interleaver input tuple bits are interleaved 

1 5 independently but are always interleaved to tuples having the same modulo sequence 
designation. 

Selector mechanism 1 163 selects between sequences 1 153 and 1151. Selector 1 163 
selects tuples corresponding to an even modulo sequence designation from the sequence 1151 
and selects tuples corresponding to an odd modulo sequence designation from sequence 1 153. 

20 The output sequence created by such a selection process is shown at 1 1 65. This output 
sequence is then coupled into mapper 1 167. The modulo sequence 1 165 corresponds to 
encoded tuples with an even modulo sequence designation selected from sequence 1151 and 
encoded tuples with an odd modulo sequence designation selected from 1 153. The even 
tuples selected are tuple MqI^ tuple M 2 J# tuple M 4 £ M and tuple M 6 £ 6 . Output sequence also 

25 comprises output tuples corresponding to odd modulo sequence designation^^, tay\zM 5 £ n 
Xu$\tM 3 £ 7 and tuple//, and.^ 

A feature of modulo tuple interleaving systems, as well as a modulo ST interleaving 
systems is that encoded versions of all the input tuple bits appear in an output tuple stream. 
This is illustrated in output sequence 1 165, which contains encoded versions of every bit of 

30 every tuple provided in the input tuple sequence 1101. 

Those skilled in the art will realize that the scheme disclosed with respect to Figures 
1 1 A and 1 IB can be easily extended to a number of interleaves as shown in Figure 8 A. In 
such a case, multiple modulo interleaves may be used. Such interleavers may be modulo 
tuple interleavers in which the tuples that will be coupled to the encoders are interleaved as 

35 tuples or the interleavers may be ST interleavers wherein the input tuples are interleaved to 
the same modulo sequence designation in the output tuples but the bits are interleaved 
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1 separately so that the output tuples of the interleavers will correspond to different bits than the 
input sequence. By interleaving tuples and bits within tuples a more effective interleaving 
may be obtained because both bits and tuples are interleaved. Additionally, the system 
illustrated in Figures 1 1 A and 1 IB comprise an encoder 1 103 which accepts the sequence of 

5 input tuples 1 101. The configuration of Figure 1 1A and 1 IB illustrates one embodiment. In 
a second embodiment the input tuples are ST interleaved before being provided to either 
encoder. In this way both the even and odd encoders can receive tuples which have had their 
component bits interleaved, thus forming an interleaving which may be more effective. In 
such a manner, an even encoder may produce a code which also benefits from IT or ST tuple 

10 interleaving. Therefore, in a second illustrative embodiment of the invention the input 

tuples are modulo interleaved before being passed to either encoder. The modulo interleaving 
may be a tuple interleaving, or a ST interleaving. Additionally, the types of interleaving can 
be mixed and matched. 

Additionally, the selection of even and odd encoders is arbitrary and although the even 

1 5 encoder is shown as receiving uninterleaved tuples, it would be equivalent to switch encoders 
and have the odd encoder receive uninterleaved tuples. Additionally, as previously 
mentioned the tuples provided to both encoders may be interleaved. 

Figure 12 is a combination block diagram and graphical illustration of a rate Vz parallel 
concatenated encoder (PCE) employing a modulo-N interleaves Figure 12 is provided for 

20 further illustration of the concept of modulo interleaving. Figure 12 is an illustration of a 
parallel concatenated encoder with rate Vz constituent encoders 1207 and 1209. The input 
tuples to the encoder 1201 are provided to rate Vz encoder 1207. Each input tuple, for 
example, T 0 , T„ T 2 and T n given an input tuple number corresponding to the order in which it 
is provided to the encoder 1207 and interleaver 121 1. The input tuple number corresponds to 

25 the subscript of the input tuple. For example, T 0 the zero tuple is the first tuple provided to 
the rate Vz encoder 1207, T t is the second tuple provided to the rate Vz encoder 1207, T 2 is the 
third tuple provided to the rate 54 input encoder 1207 and T n is the N plus first tuple provided 
to the rate Vz encoder 1207. The input tuples may be a single bit in which case the output of 
the rate Vz encoder 1207 would comprise 2 bits. The input tuples may also comprise any 

30 number of input bits depending on the number of inputs to the rate Vz encoder 1207. The 
modulo concept illustrated is identical where the rate Vz encoder is provided with tuples 
having a single bit or multiple bits. The input tuples 1201 are assigned a modulo sequence 
designation 1205. The modulo sequence designation is formed by taking the input tuple 
number modulo-N, which is the modulo order of the interleaver. In the example illustrated, 

35 the modulo order of the interleaver 121 1 is N. Because the modulo order of the interleaver is 
N the modulo sequence designation can be any integer value between 0 and N-l . Therefore, 
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the T 0 tuple has a modulo sequence designation of 0, the T, tuple has a modulo sequence 
designation of 1, the input tuple has a modulo sequence designation of N-l, the T n input 
tuple has a modulo sequence designation of 0 and the , input tuple has a modulo sequence 
designation of 1 and so forth. Interleaver 121 1 produces interleaved tuples 1215. Similarly to 
the input tuples the interleaved tuples are given a modulo sequence designation which is the 
same modulo order as the interleaver 121 1. Therefore, if the input tuples have a modulo 
sequence designation from 0 to N-l then the interleaved tuples will have a modulo sequence 
designation of 0 to N-l. The interleaver 121 1 can interleave according to a number of 
interleaving schemes known in the art. In order to be a modulo interleaver, however, each of 
the interleaving schemes must be modified so that input tuples with a particular modulo 
sequence designation are interleaved to interleaved tuples with the same modulo sequence 
designation. The interleaved tuples are then provided to a second rate X A encoder 1209. The 
encoder 1207 encodes the input tuples, the encoder 1209 encodes the interleaved tuples and 
selector 1219 selects between the output of the encoder 1207 and the output of encoder 1209. 
It should be obvious from the foregoing description that modulo type interleaving can be 
carried out using any modulo sequence designation up to the size of the interleaver. A 
modulo-2 interleaver is typically referred to herein as an odd/even interleaver as the modulo 
sequence designation can have only the values of 1 or 0, i.e., odd or even respectively. 

Figure 13 is a graphic illustration of the functioning of a modulo-4 ST interleaver 
according to an embodiment of the invention. In the illustrated example, the modulo-4 ST 
interleaver 1301 interleaves a block of 60 tuples. That is the interleaver can accommodate 60 
input tuples and perform and interleaving on them. Input tuples 24 through 35 are illustrated 
at 1303, to demonstrate an exemplary interleaving. Interleaved tuples 0-59 are illustrated at 
1305. Input tuples 24 through 35 are illustrated at 1303 as 2 bit tuples. Input tuple 24 
includes bit boo which is the LSB or least significant bit of input tuple 24 and b 01 the MSB or 
most significant bit of input tuple 24. Similarly, input tuple 25 includes b 02 which is the least 
significant bit (LSB) of tuple 25 and b 03 which is the most significant bit of input tuple 25. 
Each input tuple 1303 is assigned a modulo sequence designation which is equal to the tuple 
number modulo-4. The modulo sequence designation of tuple 24 is 0, the modulo sequence 
designation of tuple 25 is 1, the modulo sequence designation of tuple 26 is 2, the modulo 
sequence designation of tuple 27 is 3, the modulo sequence designation of tuple 28 is 0 and so 
forth. Because 1301 is a ST interleaver, the bits of each tuple are interleaved separately. 
Although the bits of each tuple are interleaved separately, they are interleaved into an 
interleaved tuple having the same modulo sequence designation, i.e. tuple number mod 4 in 
the interleaved tuple as in the corresponding input tuple. Accordingly, bit boo the LSB of 
tuple 24 is interleaved to interleaved tuple number 4 in the least significant bit position. b 01 
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1 the MSB of input tuple 24 is interleaved to interleaved tuple 44 in the most significant bit 
position. Note that the modulo sequence designation of input tuple 24 is a 0 and modulo 
sequence designation of interleaved tuple 4 and interleaved tuple 44 are both 0. Accordingly, 
the criteria that bits of an input tuple having a given modulo sequence designation are 

5 interleaved to interleave positions having the same modulo sequence designation. Similarly, 
b 02 and b 03 of input tuple 25 are interleaved to interleaved tuple 57 and interleaved tuple 37 
respectively. and b 05 of input tuple 26 are interleaved to interleaved tuples 2 and 22. In 
like manner the MSB and LSB of all illustrated input tuples 24 through 35 are interleaved to 
corresponding interleaved tuples having the same modulo sequence designation, as illustrated 

10 in Figure 13. 

Figure 14A is a graphical illustration of a method for generating an interleaving 
sequence from a seed interleaving sequence. Interleaves may be implimented in random 
access memory (RAM). In order to interleave an input sequence, an interleaving sequence 
may be used. Because interleaves can be quite large, it may be desirable that an interleaving 

1 5 sequence occupy as little storage space within a system as feasible. Therefore, it can be 

advantageous to generate larger interleaving sequences from smaller, i.e. seed interleaving 
sequences. Figure 14A is a portion of a graphical illustration in which a seed interleaving 
sequence is used to generate four interleaving sequences each the size of the initial seed 
interleaving sequence. In order to illustrate the generation of sequences from the seed 

20 interleaving sequence, an interleaving matrix such as that 1401 may be employed. The 

interleaving matrix 1401 matches input positions with corresponding output positions. In the 
interleaving matrix 1401 the input positions I 0 through I 5 are listed sequentially. I 0 is the first 
interleaving element to enter the interleaving matrix 1401. I, is the second element, etc. As 
will be appreciated by those skilled in the art, the input elements I 0 through I 5 may be 

25 considered to be individual bits or tuples. The input positions in the interleaving matrix 1401 
are then matched with the seed sequence. By reading through the interleaving matrix 1401 an 
input position is matched with a corresponding output position. In the illustrative example, of 
the interleaving matrix 1401, input I 0 is matched with the number 3 of the seed sequence. 
This means that the I 0 or first element into the interleaving matrix 1401 occupies position 3 in 

30 the resulting first sequence. Similarly, l x will be matched with a 0 position in sequence 1 and 
so forth. In other words, the input sequence I 0 , I„ I 2 , 1 3 , I 4 , I 5 is reordered according to the seed 
sequence so that the resulting sequence output from the interleaving matrix 1401 is I ls I 2 , 1 5 , 1 0 , 
I 4 , 1 3 where the output sequence is obtained by listing the sequence of the output in the usual 
ascending order Iq, I l9 1 2 , 1 3 , 1 4 , 1 5 , where the left most position is the earliest. Put another way, 

35 the resulting sequence number 1 is {3, 4, 0, 5, 2, 1}, which corresponds to the subscript of the 
output sequence 1409. Similarly, in interleaving matrix 1403 also called the inverse 
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1 interleaving matrix or INTLV' 1 the input sequence 1400 is accepted by the interleaving matrix 
1403 but instead of being written into this interleaving matrix sequentially, as in the case with 
interleaving matrix 1401, the elements are written into the interleaving matrix according to 
the seed sequence. The interleaving matrix 1403 is known as the inverse of interleaving 

5 matrix 1401 because by applying interleaving matrix 1401 and then successively applying 

inverse interleaving matrix 1403 to any input sequence, the original sequence is recreated. In 
other words, the two columns of the interleaving matrix 1401 are swapped in order to get 
interleaving matrix 1403. Resulting output sequence 141 1 is I 3 , 1 0 , I„ I 5 , 1 4J I 2 . Therefore, 
sequence number 2 is equal to 2, 4, 5, 1 , 0, 3. 

1 0 The seed interleaving sequence can also be used to create an additional two sequences. 

The interleaving matrix 1405 is similar to interleaving matrix 1401 except that the time 
reversal of the seed sequence is used to map the corresponding output position. The output 
then of interleaver reverse (INTLVR 1405) is then I 4 , 1 3 , 1 0 , 1 5 , I„ I 2 . Therefore, sequence 3 is 
equal to 2, 1, 5, 0, 3, 4. Next an interleaving matrix 1407 which is similar to 

1 5 interleaving matrix 1403 is used. Interleaving matrix 1407 has the same input position 

elements as interleaving matrix 1403, however, except that the time reversal of the inverse of 
the seed sequence is used for the corresponding output position within interleaving matrix 
1407. In such a manner, the input sequence 1400 is reordered to I 2 , 1 4 , 1 5 , I l9 Iq, I 3 . Therefore, 
sequence number 4 is equal to 3, 0, 1, 5, 4, 2, which are, as previously, the subscripts of the 

20 outputs produced. Sequences 1 through 4 have been generated from the seed interleaving 

sequence. In one embodiment of the invention the seed interleaving sequence is an S random 
sequence as described by S. Dolinar and D. Divsalar in their paper "Weight Distributions for 
Turbo Codes Using Random and Non-Random Permeations," TDA progress report 42-121, 
JPL, August 1995. 

25 Figure 14B is a series of tables illustrating the construction of various modulo 

interleaving sequences from sequence 1 through 4 (as illustrated in Figure 14A). Table 1 
illustrates the first step in creating an interleaving sequence of modulo-2, that is an even/odd 
interleaving sequence, from sequence 1 and 2 as illustrated in Figure 14A. Sequence 1 is 
illustrated in row 1 of table 1. Sequence 2 is illustrated in row 2 of table 1. Sequence 1 and 

30 sequence 2 are then combined in row 3 of table 1 and are labeled sequence 1-2. In sequence 
1-2 elements are selected alternatively, i.e. sequentially from sequence 1 and 2 in order to 
create sequence 1-2. That is element 1, which is a 1, is selected from sequence 1 and placed 
as element 1 in sequence 1-2. The first element in sequence 2, which is a 3, is next selected 
and placed as the second element in sequence 1-2. The next element of sequence 1-2 is 

35 selected from sequence 1, the next element is selected from sequence 2, etc. Once sequence 
1-2 has been generated, the position of each element in sequence 1-2 is labeled. The position 
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1 of elements in sequence 1-2 is labeled in row 1 of table 2. The next step in generating the 
interleaving sequence, which will be sequence 5 is to multiply each of the elements in 
sequence 1-2 by the modulo of the sequence being created In this case, we are creating a 
modulo-2 sequence and therefore, each of the elements in sequence 1-2 will be multiplied by 

5 2. If a modulo-3 sequence had been created in the multiplication step, the elements would be 
multiplied by 3 as will be seen later. The multiplication step is a step in which the combined 
sequences are multiplied by the modulo of the interleaving sequence desired to be created. 

This methodology can be extended to any modulo desired. Once the sequence 1-2 
elements have been multiplied times 2, the values are placed in row 3 of table 2. The next 

1 0 step is to add to each element, now multiplied by modulo-N (here N equals 2) the modulo-N 
of the position of the element within the multiplied sequence i.e. the modulo sequence 
designation. Therefore, in a modulo-2 sequence (such as displayed in table 2) in the Oth 
position the modulo-2 value of 0 (i.e. a value of 0) is added. To position 1 the modulo-2 
value of 1 (i.e. a value of 1) is added, to position 2 the modulo-2 value of 2 (i.e. a value of 0) 

15 is added. To position 3 the modulo-2 value of 3 is (i.e. a value of 1) is added. This process 
continues for every element in the sequence being created. Modulo position number as 
illustrated in row 4 of table 2 is then added to the modulo multiplied number as illustrated in 
row 3 of table 2. The result is sequence 5 as illustrated in row five of table 2. Similarly, in 
table 3, sequence 3 and sequence 4 are interspersed in order to create sequence 3-4. In row 1 

20 of table 4, the position of each element in sequence 3-4 is listed. In row 3 of table 4 each 
element in the sequence is multiplied by the modulo (in this case 2) of the sequence to be 
created. Then a modulo of the position number is added to each multiplied element. The 
result is sequence 6 which is illustrated in row 5 of table 4. 

It should be noted that each component sequence in the creation of any modulo 

25 interleaver will contain all the same elements as any other component sequence in the 

creation of a modulo interleaver. Sequence 1 and 2 have the same elements as sequence 3 
and 4. Only the order of the elements in the sequence are changed. The order of elements in 
the component sequence may be changed in any number of a variety of ways. Four sequences 
have been illustrated as being created through the use of interleaving matrix and a seed 

30 sequence, through the use of the inverse interleaving of a seed sequence, through the use of a 
timed reversed interleaving of a seed sequence and through the use of an inverse of a time 
interleaved reverse of a seed sequence. The creation of component sequences are not limited 
to merely the methods illustrated. Multiple other methods of creating randomized and S 
randomized component sequences are known in the art. As long as the component sequences 

35 have the same elements (which are translated into addresses of the interleaving sequence) 
modulo interleavers can be created from them. The method here described is a method for 
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1 creating modulo interleavers and not for evaluating the effectiveness of the modulo 

interleavers. Effectiveness of the modulo interleavers may be dependent on a variety of 
factors which may be measured in a variety of ways. The subject of the effectiveness of 
interleavers is one currently of much discussion in the art. 

5 Table 5 is an illustration of the use of sequence 1 , 2, and 3 in order to create a modulo- 

3 interleaving sequence. In row 1 of table 5 sequence 1 is listed. In row 2 of table 5 sequence 
2 is listed and in row 3 sequence 3 is listed. The elements of each of the three sequences are 
then interspersed in row 4 of table 5 to create sequence 1-2-3. 

In table 6 the positions of the elements in sequence 1-2-3 are labeled from 0 to 17. 

1 0 Each value in sequence 1 -2-3 is then multiplied by 3, which is the modulo of the interleaving 
sequence to be created, and the result is placed in row 3 of table 6. In row 4 of table 6 a 
modulo-3 of each position is listed. The modulo-3 of each position listed will then be added 
to the sequence in row 3 of table 3, which is the elements of sequence 1-2-3 multiplied by the 
desired modulo, i.e. 3. Sequence 7 is then the result of adding the sequence 1-2-3 multiplied 

15 by 3 and adding the modulo-3 of the position of each element in sequence 1-2-3. The 
resulting sequence 7 is illustrated in table 7 at row 5. As can be seen, sequence 7 is a 
sequence of elements in which the element in the 0 position mod 3 is 0. The element in 
position 1 mod 3 is 1. The element in position 2 mod 3 is 2. The element in position 3 mod 3 
is 0 and so forth. This confirms the fact that sequence 7 is a modulo-3 interleaving sequence. 

20 Similarly, sequence 5 and 6 can be confirmed as modulo-2 interleaving sequences by noting 
the fact that each element in sequence 5 and sequence 6 is an alternating even and odd (i.e. 
modulo-2 equals 0 or modulo-2 equals 1) element. 

Figure 14C is a graphical illustration of creating a modulo-4 sequence from four 
component sequences. In table 7 sequences 1, 2, 3 and 4 from Figure 14A are listed. The 

25 elements of sequence 1, 2, 3 and 4 are then interspersed to form sequence 1-2-3-4. 

In table 8 row 1 the positions of each element in sequence 1-2-3-4 are listed. In row 3 
of table 8 each element of sequence 1-2-3-4 is multiplied by a 4 as it is desired to create a 
modulo-4 interleaving sequence. Once the elements of sequence 1-2-3-4 have been 
multiplied by 4 as illustrated in row 3 of table 8, each element has added to it a modulo-4 of 

30 the position number, i.e. the modulo sequence designation of that element within the 1-2-3-4 
sequence. The multiplied value of sequence 1-2-3-4 is then added to the modulo-4 of the 
position in sequence 8 results. Sequence 8 is listed in row 5 of table 8. To verify that the 
sequence 8 generated is a modulo-4 interleaving sequence each number in the sequence can 
be divided mod 4. When each element in sequence 6 is divided modulo-4 sequence of 0, 1, 2, 

35 3,0, 1, 2, 3, 0, 1 , 2, 3 etc. results. Thus, it is confirmed that sequence 8 is a modulo-4 

interleaving sequence, which can be used to take an input sequence of tuples and create a 
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1 modulo interleaved sequence of tuples. 

Figure 15 is a general graphical illustration of trellis-coded modulation (TCM). In 
Figure 15, input tuples designated 1501 are coupled into a trellis encoder 1503. Input tuples, 
for illustration purposes are designated T 0 , T,, T 2 and T 3 . Within the trellis encoder 1503 the 

5 input tuples 1501 are accepted by a convolutional encoder 1505. The input tuples that have 
been convolutionally encoded are mapped in a mapper 1507. The TCM process yields a 
signal constellation represented as a set of amplitude phase points (or vectors) on an In phase 
Quadrature (I-Q) plane. An example of such vectors illustrated at 1509, 1511,1513, and 
1515. The vector represented in the I-Q (In phase and Quadrature) illustration is well known 

10 in the art. The process of convolutionally encoding and mapping when taken together is 

generally referred to as trellis-coded modulation. A similar process called turbo trellis-coded 
modulation (TTCM) is illustrated in Figure 16. 

Figure 16 is a graphical illustration of TTCM (Turbo Trellis Coded Modulation) 
encoding. In Figure 16 input tuples 1601 are provided to a parallel concatenated (turbo) 

15 encoding module 1603. The parallel concatenated turbo encoding module 1603 may 

comprise a number of encoders and interleavers. Alternatively, the parallel concatenated 
encoder 1603 may comprise a minimum of two encoders and one interleaver. The output of 
the turbo encoder is then provided to an output selection and puncturing module. In module 
1605 outputs are selected from the constituent encoders of the module 1603. The selection of 

20 outputs of the different encoders is sometimes termed puncturing by various sources in the 

art, because some of the code bits (or parity bits) may be eliminated). Selection of outputs of 
the constituent encoders within the present disclosure will be referred to herein as selecting. 
The term selecting is used because, in embodiments of the present invention, encoded tuples 
are selected from different encoders, but encoded tuples corresponding to each of the input 

25 tuples are represented. For example, there may be an encoder designated the odd encoder 
from which tuples corresponding to encoded versions of odd input tuples are selected. The 
other encoder may be termed an even encoder in which the coded versions of the even tuples 
are selected This process is termed selecting because even though alternating encoded tuples 
are selected from different encoders a coded version of each input is represented. That is, in 

30 the selection process though some encoded symbols are discarded from one encoder and some 
encoded symbols are discarded from other constituent encoder(s) the selection and modulo 
interleaving process is such that encoded versions of all input elements are represented. By 
modulo encoding and selecting sequentially from all encoders, encoded versions of all input 
bits are represented. The term puncturing as used herein will be used to describe discarding 

35 parts or all of encoded tuples which have already been selected. The selected tuples are 

provided to a mapping 1607. In embodiments of the present invention the mapping may be 
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1 dependent on the source of the tuple being mapped. That is> the mapping may be changed for 
example depending on whether the tuple being mapped has been encoded or not. For 
example, a tuple from one of the encoders may be mapped in a first mapping. An uncoded 
tuple which has bypassed the encoder however may be mapped in a second mapping. 

5 Combination tuples in which part of the tuple is encoded and part of it is uncoded may also 
have different mappings. A combination of 3 blocks - block 1603, parallel concatenated 
encoding, block 1605, output selection and puncturing, and block 1607 mapping comprise 
what is known as the turbo trellis-coded modulation (TTCM) encoder 1609. The output of 
the TTCM encoder is a series of constellation vectors as illustrated by examples at 161 1, 

10 1613, 1615 and 1617. 

Figure 17 is a graphical illustration of a rate 2/3 encoder according to an embodiment 
of the invention. In Figure 1 7, input tuples T 0 and T l represented at 1701 are provided to odd 
encoder 1703. Tuple T 0 comprises bits, b 0 and b, tuple T x comprises bits b 2 and b 3 . The input 
tuples T 0 and T t are also provided to an interleaver 1705. Interleaver 1705 accepts input 

1 5 tuples (such as T 0 and T,) and after interleaving, provides the interleaved tuples to the even 

encoder 1709. When odd encoder 1703 is accepting tuple T 0 , comprising bits b 0 and b, , even 
encoder 1709 is accepting an interleaved tuple comprising bits io, and i,. Similarly, when odd 
encoder 1703 is accepting tuple T, comprising bits b 2 and b 3 even encoder 1709 is accepting 
an interleaved tuple comprising bits i 2 and i 3 . At each encoder clock (EC) both encoders 

20 accept an input tuple. The interleaver 1703 is a modulo-2 (even/odd) ST interleaver. Each 

encoder accepts every input tuple. The even/odd designation refers to which encoded tuple is 
selected to be accepted by the mapper 1715. By maintaining an even/odd interleaving 
sequence and by selecting encoded tuples alternatively from one then the other encoder, it can 
be assured that an encoded version of every input tuple is selected and passed on to the 

25 mapper 1715. For example, the encoded tuple 1711, comprising bits C3 and c 4 , and c 5 and 
corresponding to tuple T, is selected and passed onto mapper 1715, which maps both even 
and odd selections according to map 0. 

The encoded tuple c 0J Cj and c^, corresponding to input tuple T 0 is not selected from the 
odd encoder 1703. Instead, the tuple comprising bits c' 0 , c',, and c' 0 , which corresponds to 

30 the interleaved input io and i x is selected and passed on to mapper 1715, where it is mapped 
using map 0. 

Accordingly, all the components of each tuple are encoded in the odd encoder and all 
components of each tuple are also encoded in the even encoder. However, only encoded 
tuples corresponding to input tuples having an odd modulo sequence designation are selected 
35 from odd encoder 1703 and passed to the mapper 1715. Similarly only encoded tuples 

corresponding to input tuples having an even modulo sequence designation are selected from 
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1 even encoder 1709 . and passed to mapper 1703. Therefore, the odd and even designation of 
the encoders designate which tuples are selected from that encoder for the purposes of being 
mapped. 

Both encoder 1703 and 1709 in the present example of Figure 17 are convolutional, 

5 nonsystematic, recursive encoders according to Figure 5. Although only encoded versions of 
odd tuples are selected from encoder 1703, and only encoded versions of even tuples are 
selected from encoder 1709, because both encoders have memory, each encoded output tuple 
not only contains information from the tuple encoded, but also from previous tuples. 
The even/odd encoder of Figure 17 could be modified by including modulo-N 

1 0 interleaving, modulo-N interleaving could be accomplished by adding the appropriate number 
of both interleaves and encoders, to form a modulo-N TTCM encoder. Additionally, other 
configurations may be possible. For example, interleaver 1705 may be a ST interleaver. As 
an alternate another interleaver may be added prior to odd encoder 1703. For example, if a bit 
interleaver, to separate the input tuple bits were added prior to encoder 1703, and interleaver 

1 5 1 705 were an IT interleaver, the overall effect would be similar to specifying interleaver 1 705 
to be an ST interleaver. 

Both encoders 1703 and 1709 are rate 2/3 encoders. They are both nonsystematic 
convolutional recursive encoders but are not be limited to such. 

The overall TTCM encoder is a 2/3 encoder because both the odd encoder 1703 and 

20 the even encoder 1 709 accept an input tuple comprising 2 bits and output an encoded output 
tuple comprising 3 bits. So even though the output to mapper 0 switches between even and 
odd encoders, both encoders are rate 2/3 and the overall rate of the TTCM encoder of Figure 
17 remains at 2/3. 

Figure 18 is a graphical illustration of a rate Vz TTCM encoder implimented using the 
25 constituent rate 2/3 base encoders, according to an embodiment of the invention. In Figure 
1 8, exemplary input tuples T 0 and T, are provided to the TTCM encoder 1800. The T 0 tuple 
comprises a single bit b 0 and the T, tuple comprises a single bit b,. b 0 and b, corresponding to 
tuples T 0 and T, are provided to odd encoder 1803. Both b 0 and b, are also provided to 
interleaver 1 805. At the time when odd encoder 1 803 is accepting b 0 even encoder is 
30 accepting \q. i 0 is an output of the interleaver 1805. Similarly, i { is a output of interleaver 
1 805 that is provided to even encoder 1 809 at the same time that bit b, is provided to odd 
encoder 1803. The interleaver 1805 is an odd/even interleaver (modulo-2 ). In such a manner 
when an odd tuple is being provided to odd encoder 1803, an interleaver odd tuple is being 
provided to even encoder 1809. When an even tuple is being provided to odd 1803, an even 
35 interleaved tuple is being provided to even encoder 1809. In order to achieve a rate Vz code 
from rate 2/3 constituent encoders, in addition to an input comprising a single input bit, a 
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1 constant bit value provided to 1 8 1 1 is a second input of each of the constituent rate 2/3 

encoders 1803 and 1809. In Figure 18A the input bit is shown as being a 0 but could just as 
easily be set to a constant value of 1 . Additionally, each encoder input bit might be inputted 
twice to the odd encoder 1803 and the even encoder 1809 as illustrated in Figure 1 8B. 

5 Multiple other configurations are possible. For example both encoders might receive both 
input tuples as illustrated in Figure 18C, or one of the inputs might be inverted as in Figure 
1 8E. Additionally hybrid combinations, such as illustrated in Figure 1 8D are possible. 

The output of odd encoder 1 803, which corresponds to input tuple T 0 comprises bits 
c 0 , c l5 c 2 . The output tuple of odd encoder 1803 corresponding to tuple T, comprises bits c 3 , 

1 0 c 4 , and c 5 . At encoder clock EC 0 the even encoder 1 809 has produced an encoded output 

tuple having bits c' 0 , c', and c' 2 . One of the three encoded bits, in the present illustration c' 2 , is 
punctured i.e. dropped and the remaining 2 bits are then passed through to mapper 1813. 
During the odd encoder clock OC, two of three of the encoded bits provided by odd encoder 
1 803 are selected and passed to mapper 1813. Output bit c 4 is illustrated as punctured, that is 

1 5 being dropped and not being passed through the output mapper 1813. Mapper 1813 employs 
map number 3 illustrated further in Figure 24. For each encoder clock a single input tuple 
comprising 1 bit is accepted into the TTCM encoder 1800. For each clock a 2-bit encoded 
quantity is accepted by mapper 1813. Because for each one bit provided to the encoder, 2 bits 
are outputted, therefore the encoder is a rate l A encoder. The odd and even encoders in the 

20 present embodiment are nonsystematic, convolutional, recursive encoders, but are not limited 
to such. The encoders may be any combination, for example such as systematic, block 
encoders. Interleaver 1805 is an odd/even interleaver and so odd output tuples are accepted 
by the mapper 1813 from odd encoder 1803 and even encoded tuples are accepted by the 
mapper 1813 from even encoder 1809. In such a manner, all input tuples are represented in 

25 the output accepted by mapper 1813, even though some of the redundancy is punctured. 

Mapper 1813 utilizes map 3 as illustrated in Figure 25 for use by rate l A TTCM encoder 1800. 

Figure 19 is a graphical illustration of a rate 3/4 TTCM encoder, having constituent 
2/3 rate encoders, according to an embodiment of the invention. In Figure 19 the input tuples 

30 T 0 and T„ illustrated at 1901, comprise 3 bit input tuples. Input tuple T 0 comprises bits b 0 , b x 
and b 2 . Input tuple Tj comprises bits b 3 , b 4 and b 5 . Bit b 2 of input tuple T 0 is underlined as is 
^5 of input tuple T,. Bits b 2 and b 5 are underlined because neither of these bits will pass 
through either encoder. Instead, these bits will be concatenated to the output of the even or 
odd encoder and the resulting in a 4 bit tuple provided to mapper 1911. b 0 and b, of input 

35 tuple T 0 are provided to odd encoder 1 903. At the same time that b 0 and bj are being accepted 
by the odd encoder 1903, interleaved bits io and i, are being accepted by even encoder 1909. 
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1 Interleaver 1905 is an odd/even (module-2) type interleaver. The encoders illustrated at 1903 
and 1909 are the encoders illustrated in Figure 5. Encoders 1903 and 1909 are the same as 
the encoders illustrated at 1 803 and 1 809 in Figure 1 8, 1 703 and 1 709 in Figure 1 7 and as 
will be illustrated at 2003 and 2009 in Figure 20A and 2103 and 2109 in Figure 21 A In other 

5 words, the odd encoder and even encoder are rate 2/3, nonsystematic, convolutional recursive 
encoders. Other types of encoders may however be used, and types may be mixed and 
matched as desired. 

Figure 17 through 21 are encoding arrangements that utilize the same basic encoder as 
illustrated in Figure 5. In Figure 19, encoders 1903 and 1909 are illustrated as separate 

1 0 encoders for conceptual purposes. Those skilled in the art will realize that a single encoder 
may be used and may be time-shared. Figures 17 through 21 are conceptual type Figures and 
are figures that represent general concepts. They depict the general concept accurately 
regardless of the particular implementation of circuitry chosen. In the rate 3/4 encoder of 
Figure 19, the input tuples T 0 , T x (and all other input tuples to the encoder of Figure 19) 

1 5 comprise 3 bits. Since encoders 1903 and 1909 are rate 2/3 encoders with 2 input bits, then 
only 2 bits can be accommodated at a particular time. Accordingly, bit b, of tuple T 0 and bit 
^ of tuples T, bypass the encoders completely. b 5 is concatenated to the output of odd 
encoder 1903, i.e. c 3 , c 4 and c 5 the combination of encoder tuple c 3 , c 4) c 5 and bj are then 
provided to mapper 1911 which maps the output according to map 2. Map 2 is illustrated in 

20 Figure 24. Similarly, the output of even encoder 1909, comprising encoded bits c' 0 , c f , and c' 2 , 
is combined with bit b 2 of input tuple T 0 and then the combination of bj, c' 0 , c f „ c r 2 is provided 
to mapper 1911. In such a way the three bits of encoded tuples are converted into four bits 
for mapping in mapper 1911. The four bits mapped comprise the three encoded bits from 
either the odd or even encoder plus a bit from the input tuple which has by passed both 

25 encoders. 

Figure 20 A is a graphical illustration of a rate 5/6 TTCM encoder, having constituent 
2/3 rate basic encoders, according to an embodiment of the invention. In Figure 20A the 
input tuples T 0 and T, are illustrated at 2001 . Input tuple T 0 comprises five bits, b 0 through b 4 . 
Input tuple T, also comprises five bits, b 5 through b 9 . ^ of tuple T 0 and b 9 of tuple Tj are 

30 underlined to illustrate that they do not pass through either encoder. The odd encoder 2003 
accepts b 0 and b, during a first encoder clock time during which even encoder 2009 is 
accepting interleaved bits ^ and i ( . Bits i<, and i, are the outputs of the interleaver 2005 that 
correspond to the same time during which inputs b 0 and b 1 are accepted from the odd encoder. 
Similarly, the odd encoder 2003 is accepting bits and b 3 at a time when the even encoder 

35 2009 is accepting bits i 2 and i 3 . Similarly, input tuple T l9 is separated into 2 bit encoder input 
tuples because the constituent encoders are rate 2/3 encoders which accept 2 bits input and 
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1 produce three encoded bits out. Because each input tuple 2001 is five bits and because each 
encoder allows only a 2 bit input, input tuple T 0 is separated into encoder tuple b 0 and b, and 
encoder tuple and b 3 . The encoder therefore, must process two encoder input tuples for 
each input tuple 2001. Therefore, a single input tuple 2001 will require two encoder clocks 

5 for processing. The even encoder 2009 encodes tuple Iq and i, and produces corresponding 
output code bits c f 0 , c\ and c' 2 After processing i 0 and i, the even encoder 2009 processes i 2 
and i 3 The output of even encoder 2009, which corresponds to input bits i 2 and i 3 is c f 3 , c ! 4 and 
c f 5 . The odd encoder 2003 processes a first tuple b 0 and b, and then processes a second tuple 
b 2 and b 3 . Tuple b 0 and b, are accepted by encoder 2003 which produces a corresponding 

1 0 encoded 3 bit tuple c 0 , Cj and C2. After accepting b 0 and b„ the odd encoder 2003 accepts 

second tuple b 2 and b 3 and produces a corresponding output c 4 , and c 5 . Encoder output c' 0 , 
c f i and c ! 2 corresponding to encoder tuple i, and io are provided to mapper 201 1. Mapper 201 1 
uses map 0 to map c' 0 , c', and c ! 2 . Subsequently to producing c' 0 , c', and c' 2 even encoder 
2009 accepts i 2 and i 3 and produces output c 3 , c 4 , and c 5 . Instead of selecting C3, c 4 , c 5 to be 

1 5 mapped, uncoded bit 1^ is combined with interleaved bits i 2 and i 3 and selected. i 2 , i 3 and ^ 
are then accepted by mapper 201 1, which employs map 1 to map bits i 2 , i 3 and b 4 . Therefore, 
with respect to the overall input tuple T 0 five bits are input into the TTCM encoder 2000 and 
six bits are passed to mapper 201 1 . In other words, a coding rate of 5/6 is generated. 
Similarly, odd encoder 2003 encodes bits b 3 and b 6 and produces coded bits c 6 , c 7 and c 8 . 

20 Subsequently odd encoder 2003 encodes bits b 7 and b 8 and produces coded bits c 9 , c 10 and c n . 
c 6 , c 7 and c 8 are passed to the encoder 2001 as is where they are mapped using map 0. 
Encoded bit c 9 , c 10 and c n , however, are punctured, i.e. they are dropped and instead bits b 7 , 
b 8 and b 9 are substituted. b 7 , b 8 and b 9 are passed to encoder 201 1 which uses map 1 to map 
b 7 , b 8 , and b 9 . A graphical illustration of map 0 can be found in Figure 22 and a graphical 

25 illustration of Map 1 can be found in Figure 23. In the manner just described, a rate 5/6 

TTCM encoder is realized from two component rate 2/3 encoders. Interleaver 2005 is similar 
to interleaver 1705, 1805, 1905, 2005 and 2105 which also are even/odd or modulo-2 type 
interleaves. Other modulo interleavers, just as with all other embodiments illustrated in 
figures 17 through 21, can be realized by adding additional interleavers and encoders and by 

30 selecting outputs and uncoded bits in a straight format manner similar to that illustrated in 
Figure 20A. 

Figure 20B represents an alternate encoding that will yield the same coding rate as 
Figure 20A. 

Figure 21 A is a graphical illustration of a rate 8/9 TTCM encoder realized using 
35 constituent rate 2/3 encoder, according to an embodiment of the invention. To illustrate the 
functioning of TTCM rate 8/9 encoder 2100 two sequential input tuples T 0 and T u illustrated 
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1 at 2101, will be considered. Since the constituent encoders are rate 2/3 having two bits as 

input and three bits as output, the input tuples will have to be subdivided into encoder tuples. 
In other words, the input tuples will be divided into tuple pairs which can be accepted by odd 
encoder 2103 and even encoder 2109. Odd encoder 2103 accepts tuple pair b 0 and b„ pair b 2 

5 and b 3 , pair b 4 and b 5 , pair b 8 and b 9) pair b, 0 and b| „ and pair b 12 and b I3 sequentially, since 
the basic 2/3 rate encoder can only accept one pair of input bits at a time. Even encoder 
correspondingly accepts input pairs io and i,, input pair i 2 and i 3 , input pair i 4 and i 5 , input pair 
i 8 and i>, input pair i 10 and i, „ and input pair i !2 and i 13 sequentially. The pairs accepted by the 
even encoder correspond to tuple pairs having the same numbering accepted by the odd 

1 0 encoder at the same time. That is io and i, are accepted by the even encoder 2 1 09 during the 
same time period as input pair b 0 and b x is accepted by the odd encoder 2103. Odd and even 
encoders then produce encoded outputs from the input pairs accepted. Even encoder 2909 
produces a first encoded output triplet c' 0 , c f , and c' 2 followed by a second output triplet c' 3 , c f 4 
and c' 5 followed by a third output triplet c' 6 , c' 7 and c f 8 (a triplet is a 3 bit tuple). The first 

1 5 output triplet c' 0 , c', and c' 2 is accepted by the mapper 2111. The mapper 2111 utilizes map 0 
to map encoded output c' 09 c', and c ! 2 . Encoded output bits c' 3 , c' 4 and c' 5 however are 
punctured, that is not sent to the mapper. Instead of sending c f 3 , c f 4 and c ! 5 to the mapper 21 1 1 
the triplet of bits comprising i 2 , i 3 and ^ are sent to the mapper 2111. The mapper 2111 
utilizes map 1 as the mapping for the triplet i 2 , i 3 , b^ Encoded triplet c' 6 , c f 7 and c' 8 is also 

20 punctured. That is, it is not sent to the mapper 2111. Instead, i 4 , i 5 and b 7 is sent to the 
mapper 21 1 1 which uses map 1 to map input triplet i 4 , i 5 and b 7 . Because eight bits 
corresponding to tuple T 0 are accepted by the even encoder 2109 and nine bits are output into 
the mapper 21 1 1 the overall encoder 2100 is a rate 8/9 encoder. Similarly, input tuple T, is 
encoded by the odd encoder 2103. The output triplet from the odd encoder ^ c 10 and c n 

25 corresponds to input tuple b 8 and b 9 . Next, odd encoder 2103 produces an encoded output 
triplet Ci 2 , c I3 and c I4 , which is an output triplet corresponding to input pair b 10 and b u . 
Subsequently odd encoder 2103 produces output triplet c l5 , c i6 and c 17 . Output triplet c 15 , c l6 
and c 17 corresponds to input pair b 12 and b 13 . Output triplet c 9 , c 10 and c, , are sent to the 
mapper 21 1 1 which uses map 0 to map output triplet c 9 , c 10 and c n . Output triplet c l2 , c !3 and 

30 c I4 however is punctured and in its place b I0 , b 1 1 and b l4 is sent to mapper 2111 where map 1 
is employed to map the input triplet b l0 , b n and b, 4 . The encoder triplet c 15 , c 16 and c 17 is also 
punctured and a triplet comprising bj 2 , b 13 and b I5 is provided to mapper 2111. Map 1 is used 
to map the input triplet b 12 , b 13 and b l5 . In the manner just described an .8/9 encoder is 
fabricated from two constituent rate 2/3 encoder. 

35 From the foregoing TTCM encoder examples of Figures 1 7 through 21 it is seen that 

the basic rate 2/3 encoders can be used in a variety of configurations to produce a variety of 
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1 coding rates. 

The basic constituent encoders illustrated in Figures 17 through 21 are rate 2/3, 

nonsystematic, convolutional recursive encoders. These illustrations represent a few 

examples. Different types of encoders and even different rates of encoders may yield many 
5 other similar examples. Additionally, encoder types can be mixed and matched; for example, 

a recursive nonsystematic convolution encoder may be used with a nonrecursive systematic 

block encoder. 

Additionally, the interleaves illustrated in Figures 17 through 21 are modulo-2 
(even/odd) ST interleaves. Those skilled in the art will realize that IT type interleaves may 
10 be used alternatively in the embodiments of the invention illustrated in Figures 1 7 through 2 1 . 

Additionally the TTCM encoders illustrated in Figures 17 through 21 may employ 
modulo-N encoding systems instead of the modulo-2 (even/odd) encoding systems illustrated. 
For example, each of the constituent encoder - modulo-2 interleaver subsystems may be 
1 5 replaced by modulo-N subsystems such as illustrated in Figure 8A. By maintaining the same 
type puncturing and selecting with each encoder as displayed with the even/odd encoders of 
Figures 17 through 21 and extending it to modulo-N systems, such as illustrated in Figure 8 A, 
the same coding rates can be maintained in a modulo-N system for any desired value N. 
Figure 2 IB represents an alternate encoding that will yield the same coding rate as 
20 Figure 21A 

Figure 22 is a graphical illustration of map 0 according to an embodiment of the 
invention. Map 0 is used in the implementation of the rate 2/3 encoder as illustrated in Figure 
17. Map 0 is also utilized in rate 5/6 encoder illustrating in Figure 20A and rate 8/9 encoder 
illustrated in Figure 2 1 A. 

25 Figure 23 is a graphical illustration of map i according to an embodiment of the 

invention. Map 1 is used by the mapper in the rate 5/6 encoder in Figure 20A, and in the 
mapper in the rate 8/9 encoder in Figure 2 1 A. 

Figure 24 is a graphical illustration of map 2 according to an embodiment of the 
invention. Map 2 is utilized in the fabrication of the rate 3/4 encoder as illustrated in Figure 

30 19. 

Figure 25 is a graphical illustration of map 3 according to an embodiment of the 
invention. Map 3 is used in the rate Vi encoder as depicted in Figure 18. 

Maps 0 through 3 are chosen through a process different from the traditional approach 
of performing an Ungerboeck mapping (as given in the classic work "Channel Coding with 
35 Multilevel/Phase Signals" by Gottfried Ungerboeck, IEEE Transactions on Information 

Theory Vol. 28 No. 1 January 1982). In contrast in embodiments of the present invention, the 
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1 approach used to develop the mappings was to select non Ungerboeck mappings, then to 

measure the distance between the code words of the mapping. Mappings with the greatest 

average effective distance are selected. Finally the mappings with the greatest average 

effective distance are simulated and those with the best performance are selected. Average 
5 effective distance is as described by S. Dolinar and D. Divsalar in their paper "Weight 

Distributions for Turbo Codes Using Random and Non-Random Permeations," TDA 

progress report 42-121, JPL, August 1995. 

Figure 26 is a TTCM decoder according to an embodiment of the invention. Figure 

26 illustrates a block diagram of the TTCM decoder corresponding to the TTCM encoder 
1 0 described above. The TTCM decoder includes a circular buffer 2602, a metric calculator 

module 2604, two soft-in soft-out (SISO) modules 2606, 2608, two interleaves 2610, 2612, a 

conditional points processing module 2614, a first-in first-out (FIFO) register 2616, and an 

output processor 2618. 

The TTCM decoder of Figure 26 impliments a MAP (Maximum A Posteriori) 
1 5 probability decoding algorithm. 

The MAP Algorithm is used to determine the likelihood of the possible particular 

information bits transmitted at a particular bit time. 

Turbo decoders, in general, may employ a SOVA (Soft Output Viterbi Algorithm) for 

decoding. SOVA is derived from the classical Viterbi Decoding Algorithm (VDA). The 
20 classical VDA takes soft inputs and produces hard outputs a sequence of ones and zeros. The 

hard outputs are estimates of values, of a sequence of information bits. In general, the SOVA 

Algorithm takes the hard outputs of the classical VDA and produces weightings that represent 

the reliability of the hard outputs. 

The MAP Algorithm, implimented in the TTCM decoder of Figure 26, does not 
25 produce an intermediate hard output representing the estimated values of a sequence of 

transmitted information bits. The MAP Algorithm receives soft inputs and produces soft 

outputs directly. 

The input to the circular buffer i.e. input queue 2602 is a sequence of received tuples. 
In the embodiments of the invention illustrated in Figure 26, each of the tuples is in the form 
30 of 8-bit in-phase (I) and 8-bit quadrature (Q) signal sample where each sample represents a 
received signal point or vector in the I-Q plane. The circular buffer 2602 outputs one tuple at 
a time to the metric calculator 2604. 

The metric calculator 2604 receives I and Q values from the circular buffer 2602 and 
computes corresponding metrics representing distances form each of the 8 members of the 
35 signal constellation (using a designated MAP) to the received signal sample. The metric 
calculator 2604 then provides all eight distance metrics (soft inputs) to the SISO modules 
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1 2606 and 2608. The distance metric of a received sample point from each of the constellation 
points represents the log likelihood probability that the received sample corresponds to a 
particular constellation point. For rate 2/3, there are 8 metrics corresponding to the points in 
the constellation of whatever map is used to encode the data. In this case, the 8 metrics are 

5 equivalent to the Euclidean square distances between the value received and each of the 
constellation whatever map is used to encode the data.. 

SISO modules 2606 and 2608 are MAP type decoders that receive metrics from the 
metric calculator 2604. The SISOs then perform computations on the metrics and pass the 
resulting A Posteriori Probability (APoP) values or functions thereof (soft values) to the 

1 0 output processor 2618. 

The decoding process is done in iterations. The SISO module 2606 decodes the soft 
values which are metrics of the received values of the first constituent code corresponding to 
the constituent encoder for example 1703 (Figure 17). The SISO module 2608 decodes the 
soft values which are the APoP metrics of the received values of the second constituent code 

1 5 corresponding to the constituent encoder for example 1709 (Figure 17). The SISO modules 
simultaneously process both codes in parallel. Each of the SISO modules computes the 
metrics corresponding to the input bits for every bit position of the in the block of 10K tuples 
(representing a exemplary block of date), and for each of the trellis states that the 
corresponding encoder could have been in. 

20 One feature of the TTCM decoder is that, during each iteration, the two SISO modules 

2606, 2608 are operating in parallel. At the conclusion of each iteration, output from each 
SISO module is passed through a corresponding interleaver and the output of the interleaver 
is provided as updated or refined A Priori Probability (APrP) information to the input of other 
cross coupled SISO modules for the next iteration. 

25 After the first iteration, the SISO modules 2706, 2708 produce soft outputs to the 

interleaver 2610 and inverse interleaver 2612, respectively. The interleaver 2610 
(respectively, inverse interleaver 2612) interleaves the output from the SISO module 2606 
(respectively, 2608) and provides the resulting value to the SISO module 2608 (respectively, 
2606) as a priori information for the next iteration. Each of the SISO modules use both the 

30 metrics from the metric calculator 2604 and the updated APrP metric information from the 
other cross coupled SISO to produce a further SISO Iteration, In the present embodiment of 
the invention, the TTCM decoder uses 8 iterations in its decoding cycle. The number of 
iterations can be adjusted in firmware or can be changed depending on the decoding process. 

35 Because the component decoders SISO 2606 and 2608 operate in parallel, and because 

the SISO decoders are cross coupled, no additional decoders need to be used regardless of the 
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1 number of iterations made. The parallel cross coupled decoders can perform any number of 
decoding cycles using the same parallel cross coupled SISO units (e.g. 2606 and 2608). 

At the end of the 8 iterations the iteratively processed APoP metrics are passed to the 
output processor 2618. For code rate 2/3, the output processor 2618 uses the APoP metrics 

5 output from the interleaver 2610 and the inverse interleaver 2612 to determine the 2 

information bits of the transmitted tuple. For code rate 5/6 or 8/9, the output from the FIFO 
2616, which is the delayed output of the conditional points processing module 2614, is 
additionally needed by the output processor 2618 to determine the uncoded bit, if one is 
present. 

1 0 For rate 2/3, the conditional points processing module 2614 is not needed because 

there is no uncoded bit. For rate 5/6 or 8/9, the conditional points processing module 2614 
determines which points of the received constellation represent the uncoded bits. The output 
processor 2618 uses the output of the SISOs and the output of the conditional points 
processor 2614 to determine the value of the uncoded bit(s) that was sent by the turbo-trellis 

1 5 encoder. Such methodology of determining the value of an uncoded bit(s) is well known in 
the art as applied to trellis coding. 

Figure 27 is a TTCM modulo-4 decoder according to an embodiment of the invention. 
The modulo four decoder of Figure 27 is similar to the modulo-2 decoder illustration in 
Figure 26. The functions of the input queue 2802, metric calculator 2804, conditional points 

20 processor 2814, and first in first out (FIFO) 2816 are similar to their counterparts in Figure 
26. The signals that will be decoded by the TTCM modulo-4 decoder Figure 27 is one that 
has been coded in a modulo-4 interleaving system. Therefore, instead of having merely even 
and odd SISOs and interleavers, SISO 0, 1, 2 and 3 are used as are interleaver 0, 1, 2 and 3. 
Because the data has been encoded using a modulo-4 interleaving system, SISOs 0, 1 , 2 and 3 

25 can operate in parallel using interleaver 0, 1, 2 and 3. Once the SISOs 0 through 3 have 

processed through the points corresponding to the metrics of the points received in the input 
queue, the points can then be passed on to output process 28 1 8. Output process 28 1 8 will 
then provide decoded tuples. 

Figure 28 is a graphical illustration of a modulo-N and encoding and decoding system 

30 according to an embodiment of the invention. In Figure 28, the encoder 2800 is a modulo-N 
encoder. The modulo-N encoder illustrated has N encoders and N-l interleavers. The 
selector, 2801 selects encoded tuples sequentially from the output of encoders 0 through N. 
Selector 2801 then passes the selection onto the mapper which applies the appropriate 
mapping. The appropriately mapped data is then communicated over a channel 2803 to an 

35 input queue 2805. The functions of input 2805, metric calculator 2807, conditional points 
processor 2809 and FIFO 281 1 are similar to those illustrated in Figures 26 and 2478. The 
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1 decoder 2813 has N SISOs corresponding to the N encoders. Any desired amount of 
parallelism can be selected for the encoder decoder system with the one caveat that the 
modulo-N decoding must match the modulo-N encoding. By increasing the modulo of the 
system, more points which have been produced by the metric calculator 2807 can be 

5 processed at the same time. 

SISOs 0 through N process the points provided by the metric calculator in parallel. 
The output of one SISO provides A Priori values for the next SISO. For example SISO 0 will 
provide an A Priori value for SISO 1, SISO I will provide an A Priori value for SISO 2, etc. 
This is made possible because SISO 0 impliments a Map decoding algorithm and processes 

1 0 points that have a modulo sequence position of 0 within the block of data being processed, 
SISO 1 impliments a Map decoding algorithm and processes points that have a modulo 
sequence position of 1 within the block of data being processed, and so forth. By matching 
the modulo of the encoding system to the modulo of the decoding system the decoding of the 
data transmitted can be done in parallel. The amount of parallel processing available is 

1 5 limited only by the size of the data block being processed and the modulo of the encoding and 
decoding system that can be implimented. 

Figure 29 is a graphical illustration of the output of the TTCM encoder illustrated in 
Figure 1 7. Figure 29 retains the same convention that C stands for a coded bit. The output of 
the TTCM encoder of Figure 17 is represented by the sequences 2901 and 2903. The tuple 

20 sequence 2901 represents the actual output of rate 2/3rds encoder illustrated in Figure 1 7. 

During a first time period T 0 , bits C 0 , C x are output from the encoder. The source of bits C 0 , 
Ci and C 2 represent 3 bits encoded by the even encoder 1709. These first 3 bits are mapped 
according to mapping sequence 2903. According to mapping sequence 2903 bits C 0 , C ; and 
C 2 are mapped using map 0 as illustrated in Figure 22. Together the tuple sequence and 

25 mapping identify the type of output of the rate 2/3rds encoder illustrated in Figure 17. 

The tuple C 3 , C 4 and C 5 is provided by the encoder of Figure 17 immediately after the 
tuple comprising C 0 , C, and The tuple C 3 , C 4 and C 5 is been encoded in the odd encoder. 
The tuple sequence 2901 corresponding to time T, is the result of an encoding performed in 
the odd encoder 1703. 

30 In Figures 29 through and including Figure 33 the following conventions are adopted. 

Even encoder outputs will be shaded a light gray. The odd encoder outputs have no shading. 
In such a way the tuple sequence which comprises the output of the corresponding TTCM 
encoder can be identified. The gray shading denotes that the tuple was encoded in the even 
constituent encoder, and the lack of shading indicates that the tuple was encoded in the odd 

35 convolutional constituent encoder. Additionally uncoded bits that are associated with the 
even encoder data stream are shaded. 
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1 A letter C will represent a coded bit which is sent and an underlined letter B will 

represent unencoded bits which have not passed through either constituent encoder and a B 
without the underline will represent a bit which is encoded, but transmitted in unencoded 
form. 

5 In time sequence T 2 the TTCM output is taken from the even encoder, accordingly the 

bit C 6 , C 7 and C g appear as a gray shaded tuple sequence indicating that they were encoded by 
the even encoder. At time T3 output tuple sequence 2901 comprises C 9 , C I0 and C n which 
had been encoded by the odd encoder. All members of the tuple sequence for the rate 2/3 rds 
encoder illustrated in Figure 17 are mapped using map 0 as shown at mapping sequence 2903. 

1 0 The characterization of TTCM encoders output tuples using tuple sequence and mapping 
sequence will be used later when considering the decoding. For the present it is only 
necessary to realize that the combination of the tuple sequence and mapping sequence 
correspond to its type. The tuple type completely specifies the output of the TTCM encoder 
for the purposes of decoding. 

1 5 Figure 30 is a graphical illustration of the tuple types produced by the TTCM encoder 

illustrated in Figure 18A. The TTCM encoder illustrated in Figure 18A is a rate l A encoder. 
The rate !4 encoder illustrated in Figure 18A produces output tuples comprising 2 bits. The 
first tuple pair C 0 and C„ corresponding to output time T 0 , is produced by the even encoder 
1809 as indicated by the shading of the tuple. The next tuple corresponding to output time Ti 

20 comprises coded bits C 2 and C 3 which have been encoded by the odd encoder 1 809. 

Similarly, the tuple corresponding to time T 2 is produced by the even encoder and the tuple 
corresponding to time T 3 is produced by the odd encoder. All tuple sequences 3001 are 
mapped using to map 0 as shown by the mapping sequence 3003, The combination of tuple 
sequence 3001 and mapping sequence 3003 comprise the type of the tuple produced by the 

25 rate 54 TTCM encoder of Figure 1 8 A. The type of tuples produced by the TTCM encoder of 
Figure 18A will be useful for the purposes of decoding the output tuples. 

Figure 3 1 is a graphical illustration illustrating the tuple types produced by the rate 3/4 
encoder of Figure 19. The tuple sequence 3101, representing the output of the TTCM 
encoder of Figure 19 is a sequence of 4 bit tuples. The output tuple corresponding to time T 0 

30 is 4 bits. C 0 , C,, C 2 and unencoded bit B 0 . Tuple sequence corresponding to time T 0 is 

mapped by map 2 as shown by mapping sequence 3103. Additionally, the tuple sequence 
3101 during time T 0 is mapped by the even encoder, as illustrated by the shading. In other 
words, the uncoded bit Bq does not pass through either the even or odd encoder. It is however 
shown shaded as the tuple sequence, to which it is paired, is produced by the even encoder 

35 1909. 

Similarly, the tuple sequence corresponding to T 2 has been produced by the even 
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1 encoder. The tuple sequence corresponding to time T 2 , i.e. C 6 , and C 8 , are produced by 

even encoder 1909 and paired with unencoded bit B 2 C 6 , C 7 and C 8 are produced by the even 
encoder. Combination C 6 , C 8 and B 2 are mapped according to map 2 as illustrated in 
Figure 24. 

5 Similarly, the tuple sequences produced by the TTCM encoder of Figure 1 9 during 

times T, and T 3 are produced by the odd encoder and combined with an uncoded bit. During 
time T, the odd encoder encodes C 3 , C 4 and C 5 . C 3 , C 4 and C 5 along with B t , are mapped in 
map 2. The tuple sequence produced during time T 3 is also, a combination of the odd encoder 
and an encoded bit. As illustrated in Figure 3 1 all tuple sequences are mapped using map 2. 

1 0 Figure 32 is a graphical illustration of the tuple types produced by the rate 5/6 encoder 

illustrated in Figure 20A. The first tuple corresponding to time T 0 comprises coded bits C 0 , 
C, and C 2 . The coded bits C 0 , C, and C 2 are mapped according to map 0. During time T l5 bits 
B 0 , Bj and B 2 are produced by the encoder of Figure 20A. B 0 , B, and B 2 represent data that is 
sent uncoded they are however shown as being grayed out because bits B, and B 0 pass 

1 5 through the even encoder even though they are sent in uncoded form. The uncoded bits B 0 , 

Bi and B 2 are mapped using map 1 . Similarly, the output of the encoder at time T 4 comprises 
coded bits C 6 , C 7 and C 8 which are mapped using map 0. During time period T 5 uncoded bits 
B 6 , B 7 and B 8 form the output of the encoder. B 6 , B 7 and B 8 are mapped using map 1 . 

During time period T 2 , bits C 3 , C 4 and C 5 are selected from the odd encoder as the 

20 output of the overall 5/6 encoder illustrated in Figure 20 A. Bits C 3 , C 4 and C 5 are mapped in 
mapper 0 and form the turbo trellis coded modulated output. Similarly, during time T 6 , bit 
C 9 , C, 0 and Cj , are selected from the odd encoder and mapped according to map 0. During 
time period T 7 , uncoded bits B 9 , B ]0 and B n are selected as the output of the rate 5/6 encoder 
and are mapped according to map 1 . The chart of Figure 32 defines the types of output 

25 produced by the rate 5/6 encoder of Figure 20A. 

Figure 33 is a chart defining the types of outputs produced by the 8/9th encoder 
illustrated in Figure 21 A All uncoded outputs are mapped according to map 1. All coded 
outputs are mapped according to map 0. During times T 0 and T 6 coded outputs from the even 
encoder are selected. During times T 3 and T 9 coded output from the odd encoder are selected. 

30 Accordingly, the tuple types produced by the rate 8/9ths encoder of Figure 21 are completely 
described by the illustration of Figure 33. 

Figure 34 is a further graphical illustration of a portion of the decoder illustrated in 
Figure 26. In Figure 34 the circular buffer 2602 is further illustrated as being a pair of buffers 
3407 and 3409. Switches 3401, 3403, 3405 and 3407 operate in such a fashion as to enable 

35 the metric calculator 341 1 to receive data from one buffer while the other buffer is accepting 
data. In such a fashion one buffer can be used for processing input data by providing it to the 
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1 metric calculator and the second buffer can be used for receiving data. The metric calculator 
34 1 1 receives data, as required, from either buffer 3407 or buffer 3409 and calculates the 
distance between the received point and designated points of the data constellation produced 
by the source encoder. The symbol sequencer 3413 provides data to the metric calculator 

5 341 1 specifying the type of tuple, i.e. the constellation and bit encoding of the tuple, which is 
being decoded. The symbol sequencer also provides information to either buffer 3407 and 
3409 regarding which data bits are to be provided to the metric calculator 341 1 . The symbol 
sequencer is generally provided information, regarding the symbol types to be received, 
during the initialization of the system. Symbol typing has been discussed previously with 

1 0 respect to Figures 29 through 33. The metric calculator 341 1 calculates the metrics for each 
received point. The metrics for a particular receive point will typically comprise 8 Euclidean 
distance squared values for each point as indicated at the output of metric calculator 3411, 
The Euclidean distance of a point is illustrated in Figure 35. 

The metric calculator 341 1 of Figure 34 has two outputs 3415 and 3417. The output 

15 3415 represents eight metrics each of six bits corresponding to the Euclidian distance squared 
in the I-Q plane between a received point and all eight possible points of the signal 
constellation which represent valid received data points. Output 3417 represents the mapping 
of an encoded bit, if any is present. The output 3417 is an indicator of how to select the value 
of an uncoded bit. The value of the eight outputs at 3417 correspond to a 0 or 1 indicating 

20 whether the receive point is closer to an actual point in which the uncoded bit would assume a 
value of 0 or 1 . The method of including uncoded bits within a constellation has been well 
known in the art and practiced in connection with trellis coded modulation. It is included 
here for the sake of completeness. The uncoded bit metrics will be stored in FIFO 2616 until 
the corresponding points are decoded in the output processor 2618. Once the corresponding 

25 points are decoded in the output processor 261 8, they can be matched with the proper value 
for the uncoded bit as applied by FIFO 2616. 

Figure 35 is a graphical illustration of the process carried on within the metric 
calculator of the decoder. In Figure 35, a constellation of designated points is represented in 
the I-Q plain by points 3503, 3505, 3507, 3509, 3511, 3513, 3515 and 3517. The points just 

30 mentioned constitute an exemplary constellation of transmitted point values. In actual 
practice a received point may not match any of the designated transmission points of the 
transmitted constellation. Further a received point matching one of the points in the 
constellation illustrated may not coincide with the point that had actually been transmitted at 
the transmitter. A received point 3501 is illustrated for exemplary purposes in calculating 

35 Euclidean squared distances. Additionally, point 35 19 is illustrated at the 00 point of the I-Q 
plain. Point 35 1 9 is a point representing a received point having an equal probability of being 
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1 any point in the transmitted constellation. In other words, point 3519 is a point having an 
equal likelihood of having been transmitted as any constellation point Point 3519 will be 
used in order to provide a neutral value needed by the decoder for values not transmitted. 
The metric calculator 341 1 calculates the distance between a receive point, for 

5 example 3501, and all transmitted points in the constellation, for example, points 3503 and 

3505. The metric calculator receives the coordinates for the receive points 3501 in terms of 8 
bits I and 8 bits Q value from which it may calculate Euclidean distance squared between the 
receive point and any constellation point. For example, if receive point 3501 is accepted by 
the metric calculator 341 1 it will calculate value X(0) and Y(0), which are the displacement in 

10 the X direction and Y direction of the receive point 3501 from the constellation pointer 3503. 
The values for X(0) and Y(0) can then be squared and summed and represent D 2 (0). The 
actual distance between a receive point. 3501 and a point in the constellation, for example 
3503 can then be computed from the value for D 2 (0). The metric calculator however, 
dispenses with the calculation of the actual value of D(0) and instead employs the value D 2 (0) 

1 5 in order to save the calculation time that would be necessary to compute D(0) from D 2 (0). In 
like manner the metric calculator then computes the distance between the receive point and 
each of the individual possible points in the constellation i.e. 3503 through 3517. 

Figure 36 is a graphical illustration of the calculation of a Euclidean squared distance 
metric. Once the metric values representing the 8 metrics have been calculated, the metric 

20 calculator 2604 can then provide them to the SISOs 2606 and 2608. 

SISOs 2606 and 2608 of Figure 34 accept the values from the metric calculator 341 1. 
SISO 2606 decodes points corresponding to the odd encoder an SISO 2608 decodes point 
corresponding to the even encoder. SISOs 2606 and 2608 operate according to a map 
decoding algorithm. Within each SISO is a trellis comprising a succession of states 

25 representing all of the states of the odd or even encoder. The values associated with each 
state represent that probability that the encoder was in that particular state during the time 
period associated with that particular state. Accordingly, SISO 2606 decodes the odd encoder 
trellis and SISO 2608 decodes the even encoder trellis. Because only the odd points are 
accepted for transmission from the odd encoder SISO 2606 may contain only points 

30 corresponding to odd sequence designations and SISO 2608 contains only points 

corresponding to even sequence designations. These are the only values supplied by the 
metric calculator because these are the only values selected for transmission. Accordingly, in 
constructing the encoder trellis for both the odd encoder within SISO 2606 and the even 
encoder within SISO 2608 every other value is absent. Because a trellis can only represent a 

35 sequence of values, every other point, which is not supplied to each SISO must be fabricated 
in some manner. Because every other point in each of the two SISOs is an unknown point, 
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1 there is no reason to presume that one constellation point is more likely than any other 
constellation point. Accordingly, the points not received by the SISOs from the metric 
calculator are accorded the value of the 0 point 3519. The 00 point 3519 is chosen because it 
is equidistant, i.e. equally likely, from all the possible points in the encoded constellation. 

5 Figure 37 is a representation of a portion of a trellis diagram as may be present in 

either SISO 2606 or SISO 2608. The diagram illustrates a calculation of the likelihood of 
being in state M 3701. The likelihood of being in state M, 3701 is calculated in two different 
ways. The likelihood of being in state M 3701 at time k is proportional to the likelihood that 
a time K-l that the encoder was in a state in which the next successive state could be state M 

1 0 (times the likelihood that the transmission was made into state M). In the trellis diagram state 
M may be entered from precursor states 3703, 3705, 3707 or 3709. Therefore, the likelihood 
of being in state M 3701 is equal to the likelihood of being in state 3701, which state 0 of the 
encoder, and is symbolized by a k (0). 

The likelihood of being in state M 3701 may be evaluated using previous and future 

1 5 states. For example, if state M 3701 is such that it may be entered only from states 3703, 

3705, 3707 or 3709, then the likelihood of being in state M 3701 is equal to the summation of 
the likelihoods that it was in state 3703 and made a transition to state 3701, plus the 
likelihood that the decoder was in state 3705 and made the transition to state 3701, plus the 
likelihood that the decoder was in state 3707 and made the transition to state 3701 , plus the 

20 likelihood that the decoder was in state 3709 and made the transition to state 3701 . 

The likelihood of being in state M 3701 at time k may also be analyzed from the 
viewpoint of time k+1. That is, if state M 3701 can transition to state 371 1, state 3713, state 
3715, or state 3717, then the likelihood that the decoder was in state M 3701 at time k is " 
equal to a sum of likelihoods. That sum of likelihoods is equal to the likelihood that the 

25 decoder is in state 371 1 at time k+1 and made the transition from state 3701, plus the 

likelihood that the decoder is in state 3713 at time k+1, times the likelihood that it made the 
transition from state M 3701 , plus the likelihood that it is in state 3715 and made the 
transition from state 3701, plus the likelihood that it is in state 3717 and made the transition 
from state M 3701 . In other words, the likelihood of being in a state M is equal to the sum of 

30 likelihoods that the decoder was in a state that could transition into state M, times the 

probability that it made the transition from the precursor state to state M, summed over all 
possible precursor states. 

The likelihood of being in state M can also be evaluated from a post-cursor state. That 
is, looking backwards in time. To look backwards in time, the likelihood that the decoder 

35 was in state M at time k is equal to the likelihood that it was in a post-cursor state at time k+1 
times the transition probability that the decoder made the transition from state M to the post- 
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1 cursor state, summed over all the possible post-cursor states. In this way, the likelihood of 
being in a decoder state is commonly evaluated both from a past and future state. Although it 
may seem counter-intuitive that a present state can be evaluated from a future state, the 
problem is really semantic only. The decoder decodes a block of data in which each state, 

5 with the exception of the first time period in the block of data and the last time period in the 
block of data, has a precursor state and a post-cursor state represented. That is, the SISO 
contains a block of data in which all possible encoder states are represented over TP time 
periods, where TP is generally the length of the decoder block. The ability to approach the 
probability of being in a particular state by proceeding in both directions within the block of 

1 0 data is commonly a characteristic of map decoding. 

The exemplary trellis depicted in Figure 37 is an eight state trellis representing the 
eight possible encoder states. Additionally, there are a maximum of four paths into or out of 
any state, because the constituent encoders which created the trellis in Figure 37 had 2-bit 
inputs. Such a constituent encoder is illustrated in Figure 5. In fact, Figure 37 is merely an 

1 5 abbreviated version of the trellis of the right two-thirds constituent encoder illustrated in 
Figure 6, with an additional time period added. 

The state likelihoods, when evaluating likelihoods in the forward direction, are termed 
the 'forward state metric" and are represented by the Greek letter alpha (a). The state ■ 
likelihoods, when evaluating the likelihood of being in a particular state when evaluated in 

20 the reverse direction, are given the designation of the Greek letter beta (p). In other words, 
forward state metric is generally referred to as a, and the reverse state metric is generally 
referred to as p. 

Figure 38 is a generalized illustration of a forward state metric alpha (a) and a reverse 
state metric beta (p). The likelihood of being in state 3808 at time k is designated as a k . a k 

25 designates the forward state metric alpha at time k for a given state. Therefore, a k for state 
3808 is the likelihood that the encoder was in a trellis state equivalent to state 3808 at time k. 
Similarly, at time k-1, the likelihood that the encoder was in a state equivalent to state 3801 at 
time Ofc.j is designated as c^., (3801). The likelihood that the encoder was in state 3809 at 
time k-1 is equal to (3809). Similarly, at time k-1, the likelihood that the encoder was in 

30 state 3 8 1 8 at time k- 1 is equal to a k ., (3 8 13). Similarly, the likelihood that the encoder was in 
a state equivalent to state 3817 at time k-1 is equal to a M (3817). Therefore, to compute the 
likelihood that the encoder is in state 3803, the likelihood of being in a precursor state must 
be multiplied by the likelihood of making the transition from a precursor state into state 3803. 
The input at the encoder that causes a transition from a state 3801 to 3803 is an input 

35 of 0,0. The likelihood of transition between state 3801 and state 3803 is designated as 5(0,0) 
(i.e. delta (0,0)). Similarly, the transition from state 3809 to 3803 represents an input of 0,1, 
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the likelihood of transition between state 3809 and state 3803 is represented by delta (0,1). 
Similarly, the likelihoodof transition between state 3813 and 3803 is represented by delta 
(1,0) as a 1,0 must be received by the encoder in state 3813 to make the transition to state 
3803. Similarly, a transition from state 3817 to state 3803 can be accomplished upon the 
encoder receiving a 1,1, and therefore the transition between state 3817 and state 3803 is the 
likelihood of that transition, i.e. 5(1,1). Accordingly, the transition from state 3801 to 3803 is 
labeled 5,(0,0) indicating that this is a first transition probability and it is the transition 
probability represented by an input of 0,0. Similarly, the transition likelihood between state 
3809 and 3803 is represented by 5 2 (0,1), the transition between state 3813 and state 3803 is 
represented by 5 3 (1,0), and the likelihood of transition between state 3817 and 3803 is 
represented by 5 4 (1,1). 

The situation is similar in the case of the reverse state metric, beta (p). The likelihood 
of being in state 3807 at time k+1 is designated p k+1 (3807). Similarly, the likelihood of being 
in reverse metric states 381 1, 3815, 3819 and 3805 are equal to p k+1 (381 1), p^, (3815), p k+1 
(3819), and p k (3805). Likewise, the probability of transition between state 3805 and 3807 is 
equal to 5, (0,0), the likelihood of transition between state 3805 and 381 1 is equal to 5 5 (0,1). 
The likelihood of transition from state 3805 to 3815 is equal to 5 6 (1,0), and the likelihood of 
transition between state 3805 and 3819 is equal to 5 7 (1,1). In the exemplary illustrated of 
Figure 38, there are four ways of transitioning into or out of a state. The transitions are 
determined by the inputs to the encoder responsible for those transitions. In other words, the 
encoder must receive a minimum of two bits to decide between four different possible 
transitions. By evaluating transitions between states in terms of 2-bits inputs to the encoder at 
a given time, somewhat better performance can be realized than by evaluating the decoding in 
terms of a single bit at a time. This result may seem counter-intuitive, as it might be thought 
that evaluating a trellis in terms of a single bit, or in terms of multiple bits, would be 
equivalent. However, by evaluating the transitions in terms of how the input is provided at a 
given time, a somewhat better performance is obtained because the decoding inherently 
makes use of the noise correlation which exists between two, or more, simultaneous input 
bits. 

Accordingly, the likelihood of being in state 3701 may be represented by expression 1 . 
a k (3701) = 

(3703) x 5, (00) x app(00)+ a k ., (3705) x 8, (01) x app(01) + 
ct^ (3707) x 8 3 (10) x app(10) + a k _, (3709) x 8 4 (1 1) x app(l 1). (Expr.l) 

Similarly, p k can be represented by expression 2: 
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p k (3701) = 5, (00) x P k+l (3711) x app(OO) + 5 5 (01) 

x P m (3713) x app(Ol) + 8 6 (10) x 0 k+1 (3715) x app(10) + 5 7 (1 1) 

x ftt,, (3717) x app(l 1). (Expr. 2) 



5 Figure 39A is a block diagram further illustrating the parallel SISOs illustrated in 

Figure 26. Both SISOs, 2606 and 2608, accept channel metrics 3905, which are provided by 
the metric calculator 2604. SISO 2606 decodes the trellis corresponding to the encoding of 
the odd encoder. SISO 2608 decodes the trellis corresponding to the even encoder. The even 
and odd encoders may be, for example, the even and odd encoders illustrated in Figures 1 7 

10 through 21. SISO 2606 will accept channel metrics corresponding to even encoded tuples 
and SISO 2608 will accept channel metrics corresponding to odd tuples. SISO 2606 
assigns the zero point, i.e., the point with equally likely probability of being any of the 
transmitted points, as a metric for all the even points in its trellis. Similarly, SISO 2608 
assigns the 0,0 point, a point equally likely to be any constellation point, to all odd points in 

1 5 its trellis. The extrinsic values 3909 computed by SISO 2606 become the A Priori values 

3913 for SISO 2608. Similarly, the extrinsic values 3915, computed by SISO 2608, become 
the A Priori values 3907 for SISO 2606. After a final iteration, SISO 2606 will provide 
A Posteriori values 391 1 to the output processor 261 8. Similarly, SISO 2608 will provide 
A Posteriori values 3917 to the output processor 2618. The SISO pair of Figure 39A 

20 comprise an even/odd, or modulo-2 decoder. As indicated earlier, neither the encoding nor 
the decoding systems disclosed herein, are limited to even and odd (modulo 2) 
implementations and may be extended to any size desired. To accommodate such modulo-N 
systems, additional SISOs may be added. Such systems may achieve even greater parallelism 
then can systems employing only 1 SISO. 

25 Figure 39B is a block diagram of a modulo-N type decoder. A modulo-N decoder is 

one having N SISOs. A modulo-N decoder can provide parallel decoding for parallel 
encoded data streams, as previously discussed. Parallel decoding systems can provide more 
estimates of the points being decoded in the same amount of time as non-parallel type systems 
take. In Figure 39B, channel metrics 3951 are provided to end SISOs 3957, 3965, 3973, and 

30 3983. SISO 3973 may represent multiple SISOs. Such a modulo-N decoding system may 
have any number of SISOs desired. If a modulo-N encoding system is paired with a 
modulo-N decoding system, as disclosed herein, the decoding can take place in parallel, and 
may provide superior decoding for the same amount of time that a serial decoder would use. 
SISO 3957 computes an extrinsic value 3955, which becomes the A Priori value 3961 for 

35 SISO 3965. SISO 3965 computes an extrinsic value 3963, and then provides it as an A Priori 
value 3969 to SISO chain 3973. SISOs 3973 may comprise any number of SISOs configured 
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1 similarly to SISO 3965. The final SISO in the SISO chain 3973 provides an extrinsic value 
3971, which becomes an A Priori value 3977 for SISO 3983. The extrinsic value 3979, 
computed by SISO 3983, can provide an A Priori value 3953 for SISO 3957. Each SISO then 
can provide A Posteriori values, i.e., 3959, 3967, 3981, and the series of A Posteriori values 

5 3975, to an output processor such as illustrated at 2718. 

Figure 40 is a block diagram illustrating the workings of a SISO such as that illustrated 
at 2606, 3957, 2606 or 2701. The inputs to the SISO 4000 comprise the channel metrics 4001 
and the A Priori values 4003 . Both the A Priori value 4003 and the channel metrics 400 1 are 
accepted by the alpha computer 4007. The A Priori values and channel metrics are also 

1 0 accepted by a latency block 4005, which provides the delays necessary for the proper internal 
synchronization of the SISO 4000. The alpha computer 4007 computes alpha values and 
pushes them on, and pops them from, a stack 4017. The output of the alpha computer also is 
provided to a dual stack 4009. 

Latency block 4005 allows the SISO 4000 to match the latency through the alpha 

1 5 computer 4007. The dual stack 4009 serves to receive values from the latency block 4005 
and the alpha computer 4007. While one of the dual stacks is receiving the values from the 
alpha computer and the latency block, the other of the dual stacks is providing values to the 
Ex. Beta values are computed in beta computer 401 1, latency block 4013 matches the latency 
caused by the beta computer 401 1 , the alpha to beta values are then combined in metric 

20 calculator block 4015, which provides the extrinsic values 4017, to be used by other SISOs as 
A Priori values. In the last reiteration, the extrinsic values 4017 plus the A Priori values will 
provide the A Posteriori values for the output processor. 

SISO 4000 may be used as a part of a system to decode various size data blocks. In 
one exemplary embodiment, a block of approximately 10,000 2-bit tuples is decoded. As can 

25 be readily seen, in order to compute a block of 10,000 2-bit tuples, a significant amount of 
memory may be used in storing the a values, retention of such large amounts of data can 
make the cost of a system prohibitive. Accordingly, techniques for minimizing the amount of 
memory required by the SISO's computation can provide significant memory savings. 

A first memory savings can be realized by retaining the I and Q values of the incoming 

30 constellation points within the circular buffer 2602. The metrics of those points are then 

calculated by the metric calculator 2604, as needed. If the metrics of the points retained in the 
circular buffer 2602 were all calculated beforehand, each point would comprise eight metrics, 
representing the Euclidian distance squared between the received point and all eight possible 
constellation points. That would mean that each point in circular buffer 2602 would translate 

35 into eight metric values, thereby requiring over 80,000 memory slots capable of holding 

Euclidian squared values of the metrics calculated. Such values might comprise six bits or 
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1 more. If each metric value comprises six bits, then six bits times 10,000 symbols, times eight 
metrics per symbol, would result in nearly one-half megabit of RAM being required to store 
the calculated metric values. By calculating metrics as needed, a considerable amount of 
memory can be saved. One difficulty with this approach, however, is that in a system of the 

5 type disclosed, that is, one capable of processing multiple types of encodings, the metric 
calculator must know the type of symbol being calculated in order to perform a correct 
calculation. This problem is solved by the symbol sequencer 3413 illustrated in Figure 34. 

The symbol sequencer 3413 provides to the metric calculator 341 1, and to the input 
buffers 3407 and 3409, information regarding the type of encoded tuple received in order that 

10 the metric calculator and buffers 3407 and 3409 may cooperate and properly calculate the 

metrics of the incoming data. Such input tuple typing is illustrated in Figures 29 through 33, 
and has been discussed previously. 

Figure 41 is a graphical representation of the processing of alpha values within a SISO 
such as illustrated at 2606, 4000 or 2606. One common method for processing alpha values 

15 is to compute all the alpha values in a block. Then the final alpha values can be used with the 
initial beta values in order to calculate the state metrics. If the block of data that is being 
processed is large, such as the exemplary 10,000 two-bit tuple block exemplarily calculated in 
SISO 4000, then a significant amount of memory must be allotted for storing the alpha values 
computed. An alternate method of processing alpha values is employed by the SISO unit 

20 4000. In order to save memory, all the alpha values are not stored. The a value data matrix 
within the SISO is divided into a number of sub-blocks. Because the sub-block size may not 
divide equally into the data block size, the first sub-block may be smaller than all of the 
succeeding sub-blocks which are equally sized. In the example illustrated in Figure 41, the 
sub-block size is 125 elements. The first sub-block numbered a 0 through a 100 is selected 

25 as having 101 elements in order that all the other sub-blocks may be of equal size, that is 125 
elements. The alpha computer successively computes alpha values, a 0, a 1, etc. in 
succession. The alpha values are not all retained but are merely used to compute the 
successive alpha values. Periodically an a value is pushed on a stack 4 103. So, for example, 
a value, a 100, is pushed on stack 4103 as a kind of a checkpoint. Thereafter, another 125 a 

30 values are computed and not retained. The next alpha value (alpha 225) is pushed on stack 
4103. This process continues in succession with every 126 th value being pushed on stack 
4103 until a point is reached in which the alpha computed is one sub-block size away from 
the end of the data block contained within the SISO. So, for example, in the present case 
illustrated in Figure 42, the point is reached in a block of size N when a (N-125) is reached, 

35 i.e. 125 a values from the end of the block. When the beginning of this final sub-block within 
the SISO is encountered, all alpha values are pushed on a second stack 4009. The stack 4009 
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1 will then contain all alpha values of the last sub-block. This situation is illustrated further in 
Figure 42. 

Figure 42 is a graphical illustration of the alpha processing within the SISO 4000. 
The alpha values are processed in sub-blocks of data. For the purposes of illustration, a sub- 

5 block of data is taken to be 126 alpha values. A sub-block, however, may be of various 
sizes depending on the constraints of the particular implementation desired. The alpha 
block of data is illustrated at 4200 in Figure 42. The first step in processing the alpha block 
4200 is to begin at the end of block 4215 and divide the block 4200 into sub-blocks. Sub- 
blocks 4219, 4221 and 4223 are illustrated in Figure 42. Once the block 4200 has been 

1 0 divided into sub-blocks marked by checkpoint values 4209, 4207, 4205, 4203 and 4201 , the 
processing may begin. Alpha computer 4007 begins calculating alpha values at the 
beginning of the block, designated by 4217. Alpha values are computed successively and 
discarded until alpha value 4209, i.e., a checkpoint value, is computed. The checkpoint 
value 4209 is then pushed on stack 4019. Alpha computer 4007 then continues to compute 

1 5 alpha values until checkpoint value 4207 is reached. Once checkpoint value 4207 is 
reached, it is pushed on stack 4019. The distance between checkpoint value 4209 and 
checkpoint value 4207 is 125 values, i.e., one sub-block. Similarly, alpha values are 
computed from 4207 to 4205 and discarded. Checkpoint value 4205 is then pushed on stack 
4019 and the process continues. The alpha computer then computes alpha values and 

20 continues to discard them until checkpoint value 4203 is reached. At which point, 

checkpoint value 4203 is pushed on the stack 4019. The alpha computer once again begins 
computing alpha values starting with alpha value 4203 until, 125 alpha values have been 
computed and the beginning of sub-block 4219 is reached. Sub-block 4219 is the final sub- 
block. The alpha computer 4007 computes alpha values for sub-block 4219 pushing every 

25 alpha value on stack A 4009. Because sub-block 4219 contains 125 elements, once the 

alpha computer has computed all of sub-block 4219, stack A will contain 125 alpha values. 
Once the alpha values for sub-block 4219 have been computed, the alpha computer will then 
pop value 4203 off stack 4019 and begin to compute each and every value for sub-block 
4221 . Values for sub-block 4221 are pushed on stack B 4009. While the values for sub- 

30 block 4221 are being pushed on stack B 4009, the previous values which had been pushed 
on stack A 4009 are being popped from the stack. Beta values 421 1, which are computed in 
the opposite direction of the alpha values, are computed beginning with the end of block 
4200 marked at 42 1 5 . The beta values 42 1 1 are combined with the alpha values, as they are 
popped from stack A 4009, in the extrinsic calculator 4015. The beta values 421 1 and the 

35 alpha values from stack A 4009 are combined until the last alpha element has been popped 
from stack A 4009. Once stack A 4009 has been emptied, it may once again begin receiving 
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1 alpha values. Checkpoint alpha value 4205 is popped from stack 4019 and used as a starting 
value for the alpha computer 4007. The alpha computer may then compute the alpha values 
for sub-block 4223 are pushed onto the just emptied stack A 4009. While the alpha values 
are being computed and pushed on stack A 4009, the alpha values are being popped from 

5 stack B 4009 and combined with beta values 4213 in extrinsic calculator 4015. 

In the manner just described, the SISO computes blocks of data one sub-block at a 
time. Computing blocks of data one sub-block at a time limits the amount of memory that 
must be used by the SISO. Instead of having to store an entire block of alpha values within 
the SISO for the computation, only the sub-block values and checkpoint values are stored. 

1 0 Additionally, by providing two stacks 4009 A and B, one sub-block can be processed while 
another sub-block is being computed. 

Figure 43 is a block diagram further illustrating the read-write architecture of the 
interleaver and deinterleaver of the decoder as illustrated in Figure 26. The interleaver and 
deinterleaver are essentially combined utilizing eight RAM blocks 4303, 4305, 4307, 4309, 

15 431 1, 4313, 4315, and 4317. The addressing of the eight RAMs is controlled by a central 
address generator 4301. The address generator essentially produces eight streams of 
addresses, one for each RAM. Each interleaver and deinterleaver takes two sets of values 
and also produces two sets of values. There are eight RAM blocks because each input tuple 
data point, comprising two bits, has each bit interleaved and deinterleaved separately. As 

20 the alpha and beta computations are being performed in the SISOs, the a priori information 
is being read from an interleaver and deinterleaver. While the information is being read 
from an interleaver and deinterleaver, an iteration computation is proceeding and values are 
being written to the interleavers and deinterleavers. Therefore, at any time point, four 
separate RAMs may be in the process of being written to, and four separate RAMs may be 

25 in the process of being read. The generation of address sequences for the 
interleaver/deinterleavers of the SISO system is somewhat complex. 

Figure 44 is a graphical illustration illustrating the generation of decoder sequences 
for the interleaver/deinterleaver addressing illustrated in Figure 43. Since the decoder 
sequences are somewhat long, and may be greater than 10,000 addresses in length, short 

30 examples are used to illustrate the principles involved. A portion of the memory of address 
generator 4301 is illustrated at 4415. Within the memory 4415, an interleave sequence is 
stored. The interleave sequence is stored as illustrated by arrows 4401 and 4403. That is, 
the interleave sequence is stored in a first direction, then in a second direction. In such a 
manner, address 0, illustrated at 4417 stores the interleave position for the first and last 

35 words of the interleave sequence. The next memory location, after 4417 will store the 
interleave position for the second and the second to last words in the block, and so forth. 
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1 The storage of sequences is done in this manner the interleave and deinterleave sequences 
for encoded bit 1 is the time reversal of the interleave sequence for encoded bit 0. In such a 
way, interleave sequences for the two information bits which are st interleaved may be 
stored with no increased storage requirement over a sequence being stored for just one of the 

5 bits, i.e. a system in which the two information bits are it interleaved. In such a manner, a 
sequence for a bit interleaver can be achieved using the same amount of data to store that 
sequence as would be the case for a two-bit it interleaver. The interleaving/deinterleaving 
sequence for one of the two information bits is the time reversal of the 
interleaving/deinterleaving sequence, for the other information bit. For the practical 

1 0 purposes of interleaving and detnterleaving. the sequences thus generated are effectively 
independent. 

A second constraint that the interleave sequence has is that odd positions interleave to 
odd positions and even positions interleave to even positions in order to correspond to the 
encoding method described previously. The even and odd sequences are used by way of 

1 5 illustration. The method being described can be extended to a modulo N-type sequence 

where N is whatever integer value desired. It is also desirable to produce.both the sequence 
and the inverse sequence without having the requirement of storing both. The basic method 
of generating both the sequence and the inverse sequence is to use a sequence in a first case 
to write in a permuted manner to RAM according to the sequence, and in the second case to 

20 read from RAM in a permuted manner according to the sequence. In other words, in one 
case the values are written sequentially and read in a permuted manner, and in the second 
case they are written in a permuted manner and read sequentially. This method is briefly 
illustrated in the following. For a more thorough discussion, refer to the previous encoder 
discussion. In other words, an address stream for the interleaving and deinterleaving 

25 sequence of Figure 43 can be produced through the expedient of writing received data 

sequentially and then reading it according to a permuted sequence, as well as writing data 
according to a permuted sequence and then reading it sequentially. Additionally, even 
addresses must be written to even addresses and odd addresses must be written to odd 
addresses in the example decoder illustrated. Of course, as stated previously, this even odd, 

30 modulo 2, scheme may be extended to any modulo level. 

As further illustration, consider the sequence of elements A, B, C, D, E, and F 4409. 
Sequence 4409 is merely a permutation of a sequence of addresses 0, 1, 2, 3, 4, and 5, and so 
forth, that is, sequence 441 1 . It has been previously shown that sequences may be generated 
wherein even positions interleave to even positions and odd positions interleave to odd 

35 positions. Furthermore, it has been shown that modulo interleaving sequences, where a 
modulo N position will always interleave to a position having the same modulo N, can be 
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1 generated. Another way to generate such sequences is to treat the even sequence as a 

completely separate sequence from the odd sequence and to generate interleaving addresses 
for the odd and even sequences accordingly. By separating the sequences, it is assured that 
an even address is never mapped to an odd address or vice-versa. This methodology can be 

5 applied to modulo N sequences in which each sequence of the modulo N sequence is 

generated separately. By generating the sequences separately, no writing to or reading from 
incorrect addresses will be encountered. 

In the present example, the odd interleaver sequence is the inverse permutation of the 
sequence used to interleave the even sequence. In other words, the interleave sequence for 

1 0 the even positions would be the deinterleave sequence for the odd positions and the 

deinterleave sequence for the odd positions will be the interleave sequence for the even 
positions. By doing so, the odd sequence and even sequence generate a code have the same 
distant properties. Furthermore, generating a good odd sequence automatically guarantees 
the generation of a good even sequence derived from the odd sequence. So, for example, 

1 5 examining the write address for one of the channels of the sequence as illustrated in 4405. 
The sequence 4405 is formed from sequences 4409 and 441 1. Sequence 4409 is a 
permutation of sequence 441 1, which is obviously a sequential sequence. Sequence 4405 
would then represent the write addresses for a given bit lane (the bits are interleaved 
separately, thus resulting in two separate bit lanes). The inverse sequence 4407 would then 

20 represent the read addresses. The interleave sequence for the odd positions is the inverse of 
the interleave sequence for the odd positions. So while positions A, B, C, D, E and F are 
written to, positions 0, 1, 2, 3, 4, and 5 would be read from. Therefore, if it is not desired to 
write the even and odd sequence to separate RAMs, sequences 4405 and 4407 may each be 
multiplied by 2 and have a 1 added to every other position. This procedure of ensuring that 

25 the odd position addresses specify only odd position addresses and even position addresses 
interleave to only even position addresses is the same as discussed with respect to the 
encoder. The decoder may proceed on exactly the same basis as the encoder with respect to 
interleaving to odd and even positions. All comments regarding methodologies for creating 
sequences of interleaving apply to both the encoder and decoder. Both the encoder and 

30 decoder can use odd and even or modulo N interleaving, depending on the application 

desired. If the interleaver is according to table 4413 with the write addresses represented by 
sequence 4405 and the read addresses represented by 4407, then the deinterleaver would be 
the same table 4413 with the write addresses represented by sequence 4407 and the read 
addresses represented by sequence 4405. Further interleave and deinterleave sequences can 

35 be generated by time reversing sequences 4405 and 4407. This is shown in table 4419. That 
is, the second bit may have an interleaving sequence corresponding to a write address 
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1 represented by sequence 4421 of table 4419 and a read address of 4422. The deinterleaver 
corresponding to a write sequence of 4421 and a read sequence of 4422 will be a read 
sequence of 4422 and a write sequence of 4421 . 

Figure 45 is a graphical illustration of a decoder trellis according to an embodiment 

5 of the invention. A decoder trellis, in general, represents possible states of the encoder, the 
likelihood of being in individual states, and the transitions which may occur between states. 
In Figure 45, the encoder represented is a turbo trellis coded modulation encoder having odd 
even interleaving and constituent encoders as illustrated in Figure 5. In Figure 45, a 
transition into state 0 at time equal to k+1 is illustrated. The likelihood that the encoder is in 

1 0 state 0 at time k+1 is proportional to a M (0), i.e., state 45 1 1 . To end up in state 45 1 1 , at 
time k+1, the encoder had to be in state 0, state 1, state 2, or state 3 at time k. This is so 
because, as illustrated in Figure 45, the precursor state for state 451 1 is stated 4503, 4505, 
4507 or 4509 only. These transitions are in accordance with the trellis diagram of Figure 6. 
Accordingly, the enter state 451 1 at time k+1, the encoder must be in state 4503 and transit 

1 5 along path number 1, or the encoder may be in state 4505 and transition along path 2 into 
state 45 1 1 , or the encoder may be in state 4507 and transit along path 3 to state 45 1 1 , or the 
encoder may be in state 4509 and transit into state 45 1 1 . If the encoder is in state 4503, that 
is, state 0, at time k and the encoder receives an input of 00, it will transition along path 1 
and provide an output of 000 as indicated in Figure 45. If the encoder is in state 1 at time k, 

20 that is, state 4505, and the encoder receives an input of 10, it will transition according to 

path 2 and output a value of 1 0 V If the encoder is in state 2, corresponding to state 4507 at 
time k, and the encoder receives an input of 1 1, then the encoder will transition along path 3 
into state 451 1, outputting a 1 10. If the encoder is in state 3, corresponding to state 4509 at 
time k, and the encoder received an input of a 01, then the encoder will transition along path 

25 4 into state 45 1 1 and output a 01 1 . 

Therefore, to find the likelihood that the encoder is in state 0, i.e., 45 1 1 , at time k+1 , 
it is necessary to consider the likelihood that the encoder was in a precursor state, that is, 
state 0-3, and made the transition into state 0 at time k+1 . 

Likelihoods within the decoder system are based upon the Euclidian distance mean 

30 squared between a receive point and a possible transmitted constellation point, as illustrated 
and discussed with reference to Figure 35. The likelihood metrics used in the illustrative 
decoder (for example, as drawn in Figure 26) are inversely proportional to the probability 
that a received point is equal to a constellation point. To illustrate the likelihood function, 
consider point 3501 of Figure 35. Point 3501 represents a received signal value in the I-Q 

35 plane. Received point 3501 does not correspond to any point in the transmitted 

constellation, that is, point 3503 through point 3517. Received point 3501 may in have been 

-57- 



WO 02/23739 



PCT/US01/28974 



1 transmitted as any of the points 3503 through 3517. The likelihood that the received point 
3501 is actually point 3503 is equal to the Euclidian squared distance between received 
point 3501 and point 3503. Similarly, the likelihood that received point 3501 is any of the 
other points within Figure 35 is equal to the distance between the received point 3501 and 

5 the candidate point squared. In other words, the metric representing the likelihood that 

received point 3501 is equal to a constellation point is proportional to the distance squared 
between the received point and any constellation point. Thus, the higher value for the 
metric, representing the distance between the received point and the constellation point, the 
less likely that the received point was transmitted as the constellation point. In other words, 

10 if the distance squared between the received point is 0, then it is highly likely that the 
received point and the constellation point are the same point. NOTE: Even though the 
received point may coincide with one constellation point, it may have been in fact 
transmitted as another constellation point, and accordingly there is always a likelihood that 
the received point corresponds to each of the points within the constellation. In other words, 

15 no matter where received point 350 1 is located in the I-Q plane, there is some finite 

likelihood that point 3503 was transmitted, there is some finite likelihood that point 3505 
was transmitted, there is some finite likelihood that point 3507 was transmitted, and so 
forth. Because the map decoder illustrated in the present disclosure is a probabilistic 
decoder, all the points within a decoding trellis, such as illustrated at 45, have some 

20 likelihood. An iterative decoder generally assigns likelihoods to each of the given points 
and only in the last iteration are the likelihood values, that is, soft values, turned into hard 
values of 1 or 0. Probabilistic decoders in general make successive estimates of the points 
received and iteratively refine the estimates. Although there are many different ways of 
representing the probability or likelihood of points, for example Hamming distances, the 

25 decoder of the present embodiment uses the Euclidian distance squared. The Min* 
operation is described and illustrated later in this disclosure. 

Because the Euclidean distance squared is used as the likelihood metric in the present 
embodiment of the decoder the higher value for the likelihood metrics indicate a lower 
probability that the received point is the constellation point being computed. That is, if the 

30 metric of a received point is zero then the received point actually coincides with a 

constellation point and thus has a high probability of being the constellation point. If, on the 
other hand, the metric is a high value then the distance between the constellation point and 
the received point is larger and the likelihood that the constellation point is equal to the 
received point is lower. Thus, in the present disclosure the term "likelihood" is used in most 

35 cases. The term "likelihood" as used herein means that the lower value for the likelihood 
indicates that the point is more probably equal to a constellation point. Put simply within 

-58- 



WO 02/23739 



PCT/US01/28974 



1 the present disclosure "likelihood" is inversely proportional to probability, although 
methods herein can be applied regardless if probability or likelihood is used. 

In order to decide the likelihood that the encoder ended up in state 451 1 (i.e. state 0) 
at time k+1, the likelihood of being in state 0-3 must be considered and must be multiplied 

5 by the likelihood of making the transition from the precursor state into state 45 1 1 and 

multiplied by the a priori probability of the input bits. Although there is a finite likelihood 
that an encoder in state 0 came from state 0. There is also a finite likelihood that the 
encoder in state 0 had been in state 1 as a precursor state. There is also a finite likelihood 
that the encoder had been in state 2 as a precursor state to state 0. There is also a finite 

1 0 likelihood that the encoder had been in state 3 as a precursor state to state 0. Therefore, the 
likelihood of being in any given state is a product with a likelihood of a precursor state and 
the likelihood of a transition from that precursor state summed over all precursor states. In 
the present embodiment there are four events which may lead to state 451 1 . In order to 
more clearly convey the method of processing the four events which may lead to state 451 1 

1 5 (i.e. state 0) will be given the abbreviations A, B, C and D. Event A is the likelihood of 
being in state 4503 times the likelihood of making the transition from state 4503 to 45 1 1 . 
This event can be expressed as ot k (0) x 5 k (00) x the a priori probability that the input is equal 
to 00. a k (0) is equal to the likelihood of being in state 0 at time k. 8 k (00) is the likelihood, 
or metric, of receiving an input of 00 causing the transition from a k (0) to ct k+l (0)- In like 

20 manner Event B is the likelihood of being in state 4505 times the likelihood of making the 
transition from state 4505 to state 45 1 1 . In other words, 0^(1) x 5 k (10) x the a priori 
probability that the input is equal to 10. Event C is that the encoder was in state 4507 at 
time = k and made the transition to state 45 1 1 at time = k+1 . Similarly, this can be stated a k 
(2) * 8 fc (l 1) x the a priori probability that the input is equal to 1 1 . Event D is that the 

25 encoder was in state 4509 and made the transition into state 45 1 1 . In other words, a k (3) * 
5 k (01) x the a priori probability that the input is equal to 01 . 

The probability of being in any given state therefore, which has been abbreviated by 
alpha, is the sum of likelihoods of being in a precursor state times the likelihood of 
transition to the given state and the a priori probability of the input. In general, probabilistic 

30 decoders function by adding multiplied likelihoods. 

The multiplication of probabilities is very expensive both in terms of time consumed 
and circuitry used as when considered with respect to the operation of addition. Therefore, 
it is desirable to substitute for the multiplication of likelihoods or probabilities the addition 
of the logarithm of the probabilities or likelihoods which is an equivalent operation to 

35 multiplication. Therefore, probabilistic decoders, in which multiplications are common 
operations, ordinarily employ the addition of logarithms of numbers instead of the 
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1 multiplications of those numbers. 

The probability of being in any given state such as 451 1 is equal to the sum 
probabilities of the precursor states times the probability of transition from the precursor 
states into the present state times the a prior probability of the inputs. As discussed 

5 previously, event A is the likelihood of being in state 0 and making the transition to state 0. 
B is the event probability equivalent to being in state 1 and making the transition to state 0. 
Event C is the likelihood of being in state 2 and making the transition to state 0. Event D is 
the likelihood of being in state 3 and making the transition into state 0. To determine the 
likelihood of all the states at time k+1 transitions must be evaluated. That is there are 32 

10 possible transitions from precursor states into the current states. As stated previously, the 
likelihoods or probabilities of being in states and of having effecting certain transitions are 
ull kept within the decoder in logarithmic form in order to speed the decoding by performing 
addition instead of multiplication. This however leads to some difficulty in estimating the 
probability of being in a given state because the probability of being in a given state is equal 

15 to the sum of events A+B+C+D as previously stated. Ordinarily these probabilities of 
likelihoods would be simply added. This is not possible owing to the fact that the 
probability or likelihoods within the decoder are in logarithmic form. One solution to this 
problem is to convert the likelihoods or probabilities from logarithmic values into ordinary 
values, add them, and then convert back into a logarithmic values. As might be surmised 

20 this operation can be time consuming and complex. Instead an operation of Min* is used. 
The Min* is a variation of the more common operation of Max*. The operation of Max* is 
known in the art. Min* is an identity similar to the Max* operation but is one which may be 
performed in the present case on log likelihood values. The Min* operation is as follows. 

25 Min* (A3) = Min (A3) - In (l+e- !A * B| ) 

The Min* operation can therefore be used to find the sum of likelihoods of values 
which are in logarithmic form. 

Finally, the likelihood of being in state 451 1 is equal to the Min* (A,B 5 C,D). 

30 Unfortunately, however, Min* operation can only take 2 operands for its inputs. Two 
operands would be sufficient if the decoder being illustrated was a bit decoder in which 
there were only two precursor states for any present state. The present decoder is of a type 
of decoder, generally referred to as a symbol decoder, in which the likelihoods are evaluated 
not on the basis of individual bits input to the encoder, but on the basis of a combination, in 

35 this case pairs, of bits. Studies have shown that the decoding is slightly improved in the 
present case when the decoder is operated as a symbol decoder over when the decoder is 
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operated as a bit decoder. In reality the decoder as described is a hybrid combination 
symbol and bit decoder. 

Figure 46A is a graphical illustration of a method for applying the Min* operation to 
four different values. The configuration of Figure 46A illustrates a block diagram of a 
method for performing a Min* operation on four separate values, A, B, C and D. As 
indicated in Figure 46 A a timing goal of the operation in one particular embodiment is to be 
able to perform a Min* operation on four operands within five nanoseconds. 

Figure 46B is a graphicaLillustration further illustrating the use of the Min* 
operation. The Min* operation (pronounced Min star) is a two operand operation, meaning 
that it is most conveniently implemented as a block of circuitry having 2 input operands. In 
order to perform a Min* operation on more than two operations it is convenient to construct 
a Min star structure. A Min* structure is a cascade of two input Min* circuits such that all 
of the operands over which the Min* operation is to be performed enter the structure at one 
point only. The structure will have only one output which is the Min* performed over all 
the operands, written Min* (operand 1, operand 2 ... operand N), where N is the number of 
operands. Min* structures may be constructed in a variety of ways. For example a Min* 
operation performed over operands A, B, C and D may appear as shown at 461 1, 4613, or in 
several other configurations. Any Min* structure will provide the correct answer over the 
operands, but as illustrated in Figure 46A Min* structures may have different amounts of 
propagation delay depending on how the two operand Min* blocks are arranged. In an 
illustrative embodiment the Min* structure 461 1 can meet a maximum delay specification of 
5 nanoseconds, while the Min* structure 4613 cannot. This is so because structure 461 1 is 
what is known as a "parallel" structure. In a parallel Min* structure the operands enter the 
structure as early as possible. In a parallel structure the overall propagation delay through 
the structure is minimized. 

Figure 46B the Min* configuration of Figure 46A with the values for A, B. C, and D 
substituted, which is used to determine a k+I (0), that is the likelihood of being in state 0. The 
Four inputs to the Min* operation (that is A, B, C and D) are further defined in Figure 46B. 
The A term is equal to a k (0) plus 5 (0, 0, 0, 0), which is a metric corresponding to the 
generation of an output of 000 i.e., the metric value calculated by the metric calculator, plus 
the a priori likelihood that bit 1 equal to 0 was received by the encoder plus the priori 
likelihood that bit 0 equal 0 was received by the encoder. Because all the values illustrated 
are in logarithmic scale adding the values together produces a multiplication of the 
likelihood. 

Similarly, B = ct k (l) + S (1, 0, 1) + a priori (bit 1 « 1) + a priori (bit 0 = 0) 
Similarly C = a k (2) + 5 (1, 1, 0) + a priori (bit 1 = 1) + a priori (bit 0=1) 
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1 Similarly D = <x k (3) + 5 (0, 1 , 1) + a priori (bit 0 = 1) + a priori (bit 0 = 0). 

Figure 46B illustrates that prior to being able to perform a Min* operation on the four 

quantifies A, B, C and D several sub quantities must be added. For example, in order to 

obtain the value A to provide it to the Min* operations the values of 0^(0) must be added to 
5 the metric value 5 (0, 0, 0) plus the a priori probability that bit 1 = 0 plus the a priori 

probability that bit 0 = 0. One way to add quantities is in a cany ripple adder as illustrated 

in Figure 47. 

Figure 47 is a graphical illustration of two methods of performing electronic addition. 
The first method of performing electronic addition is through the use of the carry ripple 

1 0 adder. A carry ripple adder has basically three inputs. Two inputs for each bit to be added 
and a carry-in input. In addition to the three inputs the cany ripple adder has two outputs, 
the sum output and a carry-out output. Traditionally the carry-out output is tied to the carry 
in input of the next successive stage. Because the carry-out output from one stage is coupled 
to the carry-in input of a second stage the cany must ripple through the adders in order to 

1 5 arrive at a correct result. Performing the calculation illustrated at 4709 using a ripple carry 
adder four stages of ripple carry adders must be employed. These stages are illustrated at 
4701, 4703, 4705 and 4707. It is obvious from the diagram that in order for a correct output 
to be achieved by a ripple carry adder a carry must ripple, or be propagated from the carry- 
out of ripple carry adder 4701 through ripple carry adder 4703, through ripple carry adder 

20 4705 and finally into ripple carry adder 4707. Because the carry ripples earlier stages must 
complete their computation before the later stages can receive a valid input for the cany in 
and thus compute a valid output. In contrast using the process of carry sum addition can 
speed the addition process considerably. So in order to perform the addition 4709, carry 
save addition is performed using the format at 471 1 . Carry sum addition is a process known 

25 in the art. Carry ripple addition 4705 must have the final value ripple through 4 cany ripple 
adders in order to produce a valid result. In contrast with the carry sum adder, the 
computation of the sum and carry can be carried out simultaneously. Computation of the 
sum and cany equation will take only one delay period each. It should be obvious that a 
carry sum adder does not produce an output that is dependent on the numbers of digits being 

30 added because no ripple is generated. Only in the last stage of carry save add will a carry 
ripple effect be required. Therefore, the computation illustrated in Figure 48B may be 
speeded up through the substitution of a carry look ahead for a ripple carry type adder. 

Figure 48A is a block diagram in which a carry sum adder is added to a Min* circuit 
according to an embodiment of the invention. Figure 48 A is essentially a copy of the circuit 

35 of Figure 46B with the addition of carry ripple adder 4801 and carry save adder 4803. The 
carry ripple adder 4801 performs a carry sum add on the likelihood that an a priori (bit 0 = 
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1 0), the likelihood that an a priori (bit 1 = 0) and the likelihood of the transition metric A 
(0,0,0). The inputs for carry ripple adder 4801 may be added in carry sum adder 4803, 
however, since the inputs to the carry ripple adder are available earlier than the inputs to 
carry sum adder 4801, they may be precomputed thereby increasing the speed of the overall 

5 circuit. In addition, in Figure 48A the output of the Min* operation has been split into two 
outputs. 

Figure 48B is a block diagram in which a carry sum adder is added to a Min* circuit 
according to an embodiment of the invention. In figure 48B register 4807 has been added. 
Register 4807 holds the values of the adder until they are needed in the Min* block 4805. 

1 0 Since the inputs to adder 4801 re available before other inputs they can be combined to form 
a sum before the sum is needed thereby shortening the computation time over what would 
be the case if all the operands were combined only when they were all available. Register 
4809 can hold values LnjXfc and Min_a k until they are needed. Carry look ahead adder 4803 
is brought inside the Min* block. Carry look ahead Adder is the fastest form of addition 

1 5 known. In addition, in Figure 48B like figure 48 A the output of the Min* operation has 
been split into two outputs. 

The splitting of the Min*output will be illustrated in successive drawings. To 
understand why the outputs of the Min* is split into two separate outputs it is necessary to 
consider a typical Min* type operation. Such a typical Min* operation is illustrated in 

20 Figure 49. Figure 49 is an implementation of the Min* operation. In Figure 49 two inputs 
4901 and 4903 receive the values on which the Min* operation is to be performed. The 
values 4901 and 4903 are then subtracted in a subtracter 4905. Typically such a subtracter 
will involve negating one of the inputs and adding it to the other input. The difference 
between the A and B input is then provided at output 4907. The difference value A is used 

25 in both portions of the Min* operation. That is the sign bit of A is used to select which of 
the inputs A or B is the minimum. This input is then selected in a circuit such as 
multiplexer 4909. Multiplexer 4909 is controlled by the sign bit of the A. The output of 
multiplexer 4909 is the minimum of A, B. In addition, the A is used in the log calculation of 
Ln(l+e~ ,A| ) The output of the log calculation block 4913 is then summed with the minimum 

30 of A and B and the resulting summation is the Min* of A, B. This operation too can be sped 
up by eliminating the adder 491 1 . Instead of making an addition in adder 4901, the output 
of the log calculation block 4913, also designated as Ln_a k (0) and the output of multiplexer 
4909 abbreviated as Min_a k (0). By eliminating the addition in 491 1 the operation fo the 
Min* will be speeded up. The addition operation must still be performed elsewhere. The 

35 addition operation is performed within the Min* block 4805 in a carry save adder 4803 as 
illustrated in Figure 48A. 
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1 With respect to Figure 49, although the output of the Min* operator, that is Ln_a k (0), 

i.e. 4915 and Min_a k (0), i.e. 4917 not combined until they are combined in adder 491 1 two 
outputs are combined in block 491 1 and form the 0^(0) values 4913. The values 4913 
represent the values that are pushed on to stack 4019. As such, the operation 491 1 can be 

5 relatively slow since the a values are being pushed on a stack for later usage in any instance. 
In other words, the output of the Min* circuit of Figure 49 is calculated twice. The first 
instance is the output of the log block 4913 and the multiplexer block 4909 are maintained 
as integral outputs 4915 and 4917. The integral outputs 4915 and 4917 are fed back to the 
input of the Min* where they are combined with other values that are being added. 

1 0 Figure 50A is a graphical illustration of a portion of two Min* circuits illustrated 

generally at 5001 and 5003. In the circuit of 5001 A and B are combined but it is assumed 
that B is larger than A and the value A will always be positive. In the second circuit it is 
assumed that the value of A will be larger than B and hence the A in circuit 5003 will always 
be positive. It is obvious that both assumptions cannot be correct. It is also obvious that 

1 5 one of the two assumptions must be correct. Accordingly, the circuit is duplicated and then 
a mechanism, which will be described later, is used to select the circuit that has made the 
correct assumption. Assuming both positive and negative values for A the process of 
computation of the log quantity of 5005 or 5007 can start when the first bit is produced by 
the subtraction of A and B. In other words, it is not necessary for the entire value to be 

20 computed in order to start the calculations in blocks 5005 and 5007. Of course, one of the 
calculations will be incorrect, and will have to be discarded. Once the least significant bit 
has been produced by the subtraction of A and B, the least significant bit of A can be placed 
in the calculation block 5005 or 5007 and the log calculation started. By not waiting until 
the entire A value has been produced, the process of computation can be further speeded up. 

25 Figure SOB is a graphical illustration of a portion of two Min* circuits illustrated 

generally at 5001 and 5003. It is a variation of the circuit of Figure 50A and either circuit 
may be used for the described computation. 

Once the value of A 5 1 07 is computed, it can be used in the calculation in block 
5113. In order to properly compute the value in block 51 13, the value of A needs to be 

30 examined. Since block 5 1 1 3 the computation takes longer than the process of operating the 
multiplexer 5009 with the sign bit of the 5 value of 5007. Since there is no way to 
determine a priori which value will be larger A or B, there is no way to know that the value 
of A will always be positive. However, although it is not known a priori which will be 
larger A or B duplicate circuits can be fabricated based on the assumption that A is larger 

35 than B and a second assumption that B is larger than A. Such a circuit is illustrated in 
Figure 50. 
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1 p values to be calculated in a similar fashion to the a value and all comments with 

respect to speeding up a calculations pertain to P calculations. The speed of the a 
computation and the speed of the beta computation should be minimized so that neither 
calculation takes significantly longer than the other. In other words, all speed-up techniques 

5 that are applied to the calculation of a values may be applied to the calculation of beta 
values in the reverse direction. 

The calculation of the logarithmic portion of the Min* operation represents a 
complex calculation. The table of Figure 51A illustrates a look-up table implementation of 
the log function. Realizing a function by using a look-up table is one way of speeding a 

1 0 complex mathematical calculation. In the table it is seen that any value of delta larger than 
1.25 or smaller than 1.25 will result in a log output equal to point 5. Therefore, instead of 
actually calculating the value of the logarithmic portion of the Min* the table of Figure 5 1 A 
can be used. The table of 5 1 A equivalently can be realized by logic equations 1 and 2. 
Equation 1 represents the positive A values of the table of 5 1 A and equation 2 representing 

15 the negative A values of table 5 1 A. 

Log-out = -log (A) + 0.5 = A(l) AND A(2) Equation 1 

Log-out = -log (-A) + 0.5 = (A(0) AND A(l)) NOR A(2) Equation- 2 
Those skilled in the art will realize that any equivalent boolean expression will yield the 
same result, and that the lookup table may be equivalently replaced by logic implementing 

20 Equations 1 and 2 or their equivalents. 

Figure 51 A is a log table which contain look-up value for the calculation of the log 
portion of the Min* operation. The table of Figure 51 A also illustrates that the value of 
delta need only be known to the extent of its three least significant bits. Blocks 5 1 09 and 
5 1 1 1 in Figure 5 1 represent the calculation of the logarithm of the minus delta value and the 

25 calculation logarithm of the plus delta value. The valid calculation, between 51 09 and 5111, 
is selected by multiplexer 5115 and OR gate 5117. The output of log saturation circuit 5113 
is a 1 if all inputs are not equal to logic zero and all inputs are not equal to logic one. 

Multiplexer 5105 also is controlled by the value of delta as is multiplexer 5115. 
Multiplexer 5115 can be controlled by bit 3 of delta. (Any error caused by the selection of 

30 the wrong block 5 1 09 or 5 1 1 1 by using A bit 3 instead of A 9, the sign bit, is made up for in 
the log saturation block 5113. How this works can be determined by consider Figure 5 IB. 

Figure 5 IB is a graphical illustration of a table used in the log saturation of Figure 5 1 . 
In RANGE#2 and RANGE#4 where in_out is 0, A 3 selects the right range for in_out (i.e., 
when it's 0, it select log (+value) for in/out to be 0, and when it's 1 it selects log(- value) for 

35 in_out to be 0). In RANGE#1 (i.e., +value), when A 3 changes from 0 to 1, this would 
select incorrectly log(-value) for the mux output. However, the selected (mux) output is 
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1 overwritten at the OR gate by the Log Saturation block. This Log Saturation block detects 
that A 8:3 is not all O's (e.g., it's 000001) then it would force the in_out to be 1 which is the 
right value of RANGE#1 . 

Similarly, for RANGE#4 (i.e., -value), when A 3 changes from 1 to 0, it would select 

5 in correctly the log (+value) for the mux output. However, the selected (mux) output is 

overwritten at the OR gate by the Log Saturation block. This Log Saturation block detects 
that A 8:3 is not all Ts (e.g., it's 111110) when it would force the in/out to be 1 which is the 
right value for RANGE #4. The sign bit of A controls whether A or B is selected be passed 
through the output. The input to the A and B adders 5101 and 5103 are the same as that 

1 0 shown in Figure 48A. A and B form sums separately so that the correct sum may be 

selected by multiplexer 5105. In contrast the carry sum adder 5107 can accept all the inputs 
to A and B in order to calculate A. Of course, one of the inputs must be in two's compliment 
form so that the subtraction of A minus B can be accomplished. In other words, either the A 
or B values can be negated and two's complimented and then add to the other values in order 

15 to form the A value. The negating of a value is a simple one gate operation. Additionally, 
the forming of a two's compliment by adding one is relatively simple because in the carry 
sum addition first stage is assumed to have a carry of zero. By assuming that that carry is 
equal to one instead of a zero a two's complimentary value can be easily formed. 

Figure 52A is a graphical illustration and circuit diagram indicating a way in which a 

20 values within the SISO may be normalized. As the a values within the SISOs tend to 

converge the values in the registers patrol the a values have a tendency to grow between 
iterations. In order to keep the operation fo the SISO as economical as possible in terms of 
speed and memory usage, the value stored in the a register should be kept as small as only 
needed for the calculations to be performed. One method of doing this is the process called 

25 normalization. The process of normalization in the present embodiment occurs when the 

high order bit of the value in all the a registers is a 1 . This condition indicates that the most 
significant bit in each a register is set. Once the condition where all of the most significant 
bits in all of the a registers are set then all of the most significant bits can be reset on the 
next cycle in order to subtract a constant value from each of the values within the a registers. 

30 Such a process can be done using subtraction of course, but that would involve substantially 
more delay and hardware. The process illustrated in Figure 52 involves only one logic gate 
being inserted into the timing critical path of the circuit. Once the all most significant a bits 
condition is detected by AND gate 5201 multiplexer 5203 can be activated. Multiplexer 
5203 may be implemented as a logic gate, for example, an AND gate. Bits B 0 through B 8 

35 are provided to the Oq register. Either B 9 or a zero is provided to the register depending 
on the output of AND gate 5201. Accordingly, only 1 gate delay is added by normalizing 
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1 the a values. In such a manner a constant value can be subtracted from each of the a 
registers without increasing any cycle time of the overall decoder circuit. 

Figure 52B is a graphical illustration and circuit diagram indicating an alternate way 
in which a values within the SISO may be normalized. The circuit is similar to that 

5 illustrated in Figure 52A. The multiplexor 5203 selects only bit 9 (the most significant bit, 
as a being passed through or being normalized to 0. 
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1 WHAT IS CLAIMED IS: 

1 . A method for computing extrinsic likelihood values in a soft in soft out (SISO) 
decoder the method comprising: 

accepting a block of channel metrics and a priori values; 
5 dividing the block of channel metrics and a priori values into sub blocks 

accepting an nth channel metric and an nth a priori value into an alpha (a) 

computer; 

computing a nth a value from the nth channel metric and an nth a priori value 

using the nth a value to compute the n-H alpha value; 
1 0 pushing a values corresponding to the beginning of a sub block on a 

checkpoint stack until a beginning of the last sub block is reached; 

pushing each of the a values of the final sub block on the checkpoint stack; 

popping each of the final a values from the checkpoint stack and combining 
them with beta (P) values to form extrinsic likelihood values. 

15 

2. The method of claim 1 wherein pushing a values corresponding to the 
beginning of a sub block on a checkpoint stack further comprises: 

using each a value to compute a subsequent a value; and 

discarding each a value when it is no longer needed to compute a subsequent a 

20 value. 

3. The method of claim 2 further comprising: 

(a) popping a value, representing a first a value of a next sub block off the 
checkpoint stack; 

25 (b) computing all the a values of the next sub block and pushing them onto 

the checkpoint stack; 

(c) popping each of the a values from the checkpoint stack and combining 
them with p values to form extrinsic likelihood values; and 

(d) repeating a, b, and c until all of the a values have been used in 
30 computing extrinsic values. 

4. A method for computing extrinsic likelihood values in a soft in soft out (SISO) 
decoder the method comprising: 

accepting a block of channel metrics and a priori values; 
35 dividing the block of channel metrics and a priori values into sub blocks 

accepting an nth channel metric and an nth a priori value into an alpha (a) 
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1 computer; 

computing a nth a value from the nth channel metric and an nth a priori value 
using the nth a value to compute the n+1 alpha value; 
pushing a values corresponding to the beginning of a sub block on checkpoint 
5 stack until a beginning of the last sub block is reached; 

pushing each of the a values, once the beginning of the last sub block has been 
reached, on a first computation stack to form a first set of a values; 

popping a values of the first set of a values from the first computation stack 
once the last value of a of the sub block has been computed stack and combining a values 
1 0 from the first set of a values with beta (P) values to form extrinsic likelihood values. 

5. The method of claim 4 wherein popping the a values from the first 
computation stack proceeds essentially simultaneously with pushing a values on the second 
computation stack. 

15 

6. The method of claim 4 further comprising: 

using computational stack 1 to receive newly computed a values; and 
using the values in computational stack number 2 to combine with |i values to 
form extrinsic likelihood values thereby switching the use of computational stack 1 and 
20 computational stack 2. 

7. The method of claim 6 further comprising using computational stack 1 and 
computational stack 2 essentially simultaneously. 

25 8. The method of claim 6 further comprising providing latencies between a 

computation stack and an extrinsic calculator so that a values and corresponding P values 
reach arrive essentially simultaneously for use in extrinsic calculations. 

9. An apparatus for computing extrinsic likelihood values in a soft in soft out 
30 (SISO) decoder the apparatus comprising: 

an a computer that receives a priori values and channel metrics and computes 

a values; 

a checkpoint stack for receiving a checkpoint values from the a computer; 
a P computer that receives a priori values and channel metrics and computes P 

35 values; and 

an extrinsic calculator that accepts a values provided by the a computer and P 
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1 values provided by the p computer and produces extrinsic likelihood values. 

10. The apparatus of claim 10 further comprising: 

a first computational stack that receives a values when a second computational 
5 stack is providing computational a values; and 

a second computational stack that receives a values when a first computational 
stack is providing computational a values. 

11. An apparatus as in claim 9 wherein a checkpoint stack for receiving a 
1 0 checkpoint values from the a computer further comprises: 

means for determining a beginning of a sub block; and 

means for selecting only a first a value to be pushed on the computational 

stack. 

15 12. An apparatus as in claim 9 further comprising: 

a latency block that accepts a values and delays them to correspond to the 
arrival of p values into the extrinsic calculator. 

13. A method of computing extrinsic values for a block of metrics and 
20 corresponding a priori values the method comprising: 

computing a values and saving only checkpoint values on a stack; 
computing a values between checkpoint values when such values are required. 

14. The method of claim 13 wherein computing a values and saving only 
25 checkpoint values on a stack comprises: 

computing all <x values; 

selecting values corresponding to the beginning of a sub block as checkpoint 

values; and 

pushing the selected values on the checkpoint stack. 

30 

15. The method of claim 13 wherein computing a values between checkpoint 
values when such values are required further comprises computing a values and pushing 
them on a first stack such that the first stack is full when a second stack, which is providing 
a values, is empty. 

35 

16. The method of claim 15 further comprising switch functions of stack one and 
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1 stack two such that one stack is essentially providing a values at the same time the other 
stack is receiving values. 

17. The apparatus of claim 10 wherein a computational stack comprises a stack of 
5 entries, which store a priori values, a values and channel metrics; 

1 8. The apparatus of claim 1 7 wherein the p computer further comprises: 
an input for accepting channel metrics from a computational stack; and 
an input for accepting a priori values from a computational stack. 

10 

19. The apparatus of claim 10 wherein the first computational stack further 
comprises: 

storage elements for storing a values; 
storage elements for storing a priori values; and 
1 5 storage elements for storing channel metric values; 

20. The apparatus of claim 10 wherein the second computational stack further 
comprises: 

storage elements for storing a values; 
20 storage elements for storing a priori values; and 

storage elements for storing channel metric values; 

21. A method of calculating alpha (a) values in a map decoder, the method 
comprising: 

25 (a) selecting a state to calculate an a value for; 

(b) determining which previous states may result in a transition into the 
selected state; 

(c) determining a likelihood for each transition from a previous state into 
the selected state; 

30 (d) determining the transition having the most likelihood using a min* (min 

star) operation; 

(e) assigning the a value of the selected state to be equal to the result of the 
min* operation. 

35 22. The method of claim 21 further comprising repeating steps (a) through (e) for 

all permissible trellis states. 
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1 23 . The method of claim 2 1 further comprising repeating steps (a) through (e) 

simultaneously for all permissible trellis states. 

24. The method of claim 21 wherein determining the transition having the most 
5 likelihood using a min* (min star) operation comprises computing a log likelihood of 

transitions from a previous states into the selected state using a Min* structure. 

25. A method as in claim 24 further comprising computing simultaneously log 
likelihoods for all transitions from previous states into the selected state by performing a 

1 0 Min* to predict the likelihood of all possible transitions from a previous state into the 
selected state. 

26. The method of claim 24 wherein using a min* structure comprise using an 
parallel Min* structure. 

15 

27. The method of claim 24 further comprising adding an offset to log 
computations in the Min* operation. 

28. The method of claim 27 wherein the offset is 0.5. 

20 

29. A method as in claim 24 wherein adding the a priori probability and branch 
metrics comprises adding the a priori probability and branch metrics prior to incorporation 
into Min* operation. 

25 30. A method as in claim 24 wherein alpha values are maintained as separate 

Min_a and Ln_<x values. 

31. A method as in claim 24 wherein alpha values are maintained as separate 
Min_a and Lnjx values and are added together to be used in the calculation of extrinsic 

30 probability values. 

32. A method of calculating beta (P) values in a map decoder, the method 
comprising: 

(a) selecting a siate to calculate an p value for; 
35 (b) determining which next states may result in a transition from the 

selected state; 
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1 (c) determining a likelihood for each transition to a next state from the 

selected state; 

(d) determining the transition having the most likelihood using a min* (min 
star) operation; 

5 (e) assigning the |3 value of the selected state to be equal to the result of the 

min* operation. 

33. The method of claim 32 further comprising repeating steps (a) through (e) for 
all permissible trellis states. 

10 

34. The method of claim 32 further comprising repeating steps (a) through (e) 
simultaneously for all permissible trellis states. 

35. The method of claim 32 wherein determining the transition having the most 
1 5 likelihood using a min* (min star) operation comprises computing a log likelihood of 

transitions into next states from the selected state using a Min* structure. 

36. A method as in claim 35 further comprising computing simultaneously log 
likelihoods for all transitions into next states from the selected state by performing a Min* 

20 simultaneously of all possible transitions into a next state from the selected state. 

37. The method of claim 35 wherein using a min* structure comprise using an 
parallel Min* structure. 

25 38. The method of claim 35 further comprising adding an offset to log 

computations in the Min* operation. 

39. The method of claim 38 wherein the offset is 0.5. 

30 40. A method as in claim 35 wherein adding the a priori and branch metrics are 

added together prior to incorporation into Min* operation. 

41. A method as in claim 35 wherein beta values are maintained as separate 
Min_P and Ln_p values. 

35 

42. A method as in claim 35 wherein log likelihoods are maintained as separate 
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1 Min_p and Ln_p values and are added to be used in the calculation of extrinsic probability 
values. 

43. A method of calculating alpha (a) values in a map decoder, the method 
5 comprising: 

(a) selecting a state to calculate an a value for; 

(b) determining which previous states may result in a transition into the 
selected state; 

(c) determimng a likelihood for each transition from a previous state into 
10 the selected state; 

(d) determining the transition having the most likelihood using a max* 
(min star) operation; 

(e) assigning the a value of the selected state to be equal to the result of the 

max* operation. 

15 

44. The method of claim 43 further comprising repeating steps (a) through (e) for 
all permissible trellis states. 

45. The method of claim 43 further comprising repeating steps (a) through (e) 
20 simultaneously for all permissible trellis states. 

46. The method of claim 43 wherein determining the transition having the most 
likelihood using a max* (max star) operation comprises computing a log likelihood of 
transitions from a previous states into the selected state using a Max* structure. 

25 

47. A method as in claim 46 further comprising computing simultaneously log 
likelihoods for all transitions from previous states into the selected state by performing a 
Max* to predict the likelihood of all possible transitions from a previous state into the 
selected state. 

30 

48. The method of claim 46 wherein using a max* structure comprise using an 
parallel Max* structure. 

49. The method of claim 46 further comprising adding an offset to log 
35 computations in the Max* operation. 
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50. The method of claim 49 wherein the offset is 0.5. 

51. A method as in claim 46 wherein adding the a priori and branch metrics are 
added together prior to incorporation into Max* operation. 

52. A method as in claim 46 wherein alpha values are maintained as separate 
Minjx and Ln_cc values. 

53. A method as in claim 46 wherein alpha values are maintained as separate 
Min_cc and Lnjx values and are added together to be used in the calculation of extrinsic 
values. 

54. A method of calculating beta (P) values in a map decoder, the method 
comprising; 



selected state; 

(c) determining a likelihood for each transition to a next state from the 
selected state; 

(d) determining the transition having the most likelihood using a min* (min 
star) operation; 

(e) assigning the p value of the selected state to be equal to the result of the 
max* operation. 

55. The method of claim 54 further comprising repeating steps (a) through (e) for 
all permissible trellis states. 

56. The method of claim 54 further comprising repeating steps (a) through (e) 
simultaneously for all permissible trellis states. 

57. The method of claim 54 wherein determining the transition having the most 
likelihood using a max* (max star) operation comprises computing a log likelihood of 
transitions into next states from the selected state using a Max* structure. 

58. A method as in claim 57 further comprising computing simultaneously log 
likelihoods for all transitions into next states from the selected state by performing a Max* 



(a) 
'(b) 



selecting a state to calculate an P value for; 

determining which next states may result in a transition from the 
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1 simultaneously of all possible transitions into a next state from the selected state. 

59. The method of claim 57 wherein using a min* structure comprise using an 
parallel Max* structure. 

5 

60. The method of claim 57 further comprising adding an offset to log 
computations in the max* operation. 

61. The method of claim 60 wherein the offset is 0.5. 

10 

62. A method as in claim 57 wherein adding the a priori and branch metrics are 
added together prior to incorporation into Max* operation. 

63. A method as in claim 57 wherein beta values are maintained as separate 
1 5 MinJ3 and Ln_p values. 

64. A method as in claim 57 wherein log likelihoods are maintained as separate 
MinJ3 and Ln J3 values and are added to be used in the calculation of extrinsic values. 

65. A method for computing min star calculations, min*(A,B), in a Map decoder 
the method comprising: 

determining minjx = minimum of the operands comparing a first input (A) 
and the second input (B), wherein A comprises an a metric, a priori values and a transition 
metric for a first previous state and B comprises an a metric, a priori values and a transition 
metric for a second previous state; 

outputting min_a from the Min* operation wherein min_a comprises the 
Minimum of A and B, a first portion of the output of a Min* operation; 

computing Ln_a = -log(l+ e"^" 8 ') as a second portion of a Min* operation; and 
outputting Ln_a from the Min* operation; 

66. The method of claim 65 wherein determining min_a comprises: 
computing A-B to form a difference; and 
selecting A or B based on the sign bit of the difference. 



20 



25 



30 



35 



67. The method of claim 66 wherein selecting A or B based on the sign bit of the 
result comprises 
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coupling A and B to inputs of a multiplexor, and 

using the sign bit of the difference to control the multiplexor 

68. The method of claim 66 wherein computing A-B to use in a Lnjx calculation 
is performed essentially simultaneously with computing A and computing B to use in a 
Min_a calculation. 

69. The method of claim 65 wherein computing -log(l+ e _,A * B| ) begins as soon as 
any data is available from the A-B calculation without waiting for the A-B calculation to 
complete. 

70. The method of claim 65 wherein computing -log(l+ e" |B ' A| ) begins as soon as 
any data is available from the A-B calculation without waiting for the A-B calculation to 
complete. 

7 1 . The method as in 65 wherein computing Ln_a comprises: 
determining the sign of A - B; and 

using the result of said determination to compute Lnjx. 

72. The method as in claim 65 wherein computing Ln_ct comprises: 
computing the value of -log(l+ e"* A * B! ); 

computing the value of -log(l + e HB " A! ); and 
selecting the correct value. 

73. The method as in claim 65 wherein computing Ln_a comprises: 
computing the value of -log(l+ e" 1 ^ 61 ) + an offset; 
computing the value of -log(l+ e HB * A| ) + an offset; and 
selecting the correct value. 

74. The method of claim 73 wherein the offset is equal to 0.5. 

75. The method of claim 72 wherein computing the value of -log(l+ e HA ' B| ) 
comprises computing the value of -log(l+ e HA " B| ) to an accuracy of 2 bits. 

76. The method of claim 72 wherein computing the value of -log(l+ e* |B " A| ) 
comprises computing the value of (1+ e" |B ' A| ) to an accuracy of 2 bits. 
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1 77. The method of claim 73 wherein computing the value of -log(l+ e HA_B| ) + an 

offset comprises computing the value of -log(l+ e^ -81 ) to an accuracy of 1 bit. 

78. The method of claim 73 wherein computing the value of -log(l+ e^ 1 ) + an 
5 offset comprises computing the value of -log(l+ e HB " A| ) to an accuracy of 1 bit 

79. The method of claim 75 wherein computing the value of -log(H e* 1 ^) further 
comprises calculating the log value based on a partial result from the A-B calculation. 

1 0 80. The method of claim 75 wherein computing the value of -log(l+ e HB * A| ) further 

comprises calculating the log value based on a partial result from the A-B calculation. 

81. A method as in claim 79 wherein the partial result comprises a three least 
significant bits of the A-B calculation. 

15 

82. The method of claim 72 wherein computing the value of -log(l+ e HA " B| ) is 
essentially simultaneous with computing the value of -log(l+ e" 18 *^). 

83. A method as in claim 72 wherein selecting the correct value comprises: 
20 determining the sign bit of the A-B calculation; and 

using the sign bit to select the result of the -log(l+ e- ,A - B| ) or the -log(l+ e^) 

calculation. 

84. The method as in claim 72 wherein selecting the correct value comprises: 
25 determining the third bit of the A-B calculation; 

using the third bit to select the result of the -log(l+ e HA " B| ) or the -log(l+ e^ 1 ) 
calculation; and 

correcting for an error in selecting the result of the -Iog(l+ e*^' 81 ) or the 
-log(l+ e^ calculation. 

30 

85. The method as in claim 72 wherein selecting the correct value comprises: 
determining a bit of the A-B calculation wherein the bit is located between the second bit up 
to and including the sign bit of the A-B calculation; 

using the determined bit to select the result of the -log(l+ e iA * B| ) or the -log(l+ 
35 e' 18 "^) calculation; and 

correcting for an error in selecting the result of the -log(l+ e*^* 81 ) or the 
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1 -log(l+ e* ,B ' A| ) calculation. 

86. The method as in claim 84 wherein correcting for an error in selecting the 
result of the -log(l+ e-* A ' B| ) or the result of the -log(l+ e" 18 "* 1 ) calculation comprises: 

5 computing a value in a log saturation circuit; and 

combining the value computed in the log saturation circuit with the selected 

result. 

87. The method as in claim 86 wherein combining the value computed in the log 
1 0 saturation circuit with the selected result comprises ORing the value computed in the log 

saturation circuit with the selected result, 
accuracy of one bit. 

88. A method for computing an beta metric for a selected state in a map decoder 
15 the method comprising: 

determining minji = minimum of the operands comparing a first input (A) 
and the second input (B), wherein A comprises a P metric, a priori values and a transition 
metric for a first next state and B comprises an (3 metric, a priori values and a transition 
metric for a second next state; 
20 outputting MinJ3 from the Min* operation wherein minJ3 comprises the 

minimum of A and B, a first portion of the output of a Min* operation; 

computing LnJ3 = -log(l+ e* ,A * B| ) as a second portion of a Min* operation; and 

outputting LnJ3 from the Min* operation; 

25 89. The method of claim 88 wherein determining min_p comprises: 

computing A-B to form a difference; and 
selecting A or B based on the sign bit of the difference. 

90. The method of claim 89 wherein selecting A or B based on the sign bit of the 
30 result comprises 

coupling A and B to inputs of a multiplexor; and 

using the sign bit of the difference to control the multiplexor. 

91 . The method of claim 89 wherein computing A-B to use in a Lnjt calculation 
35 is performed essentially simultaneously with computing A and computing B to use in a 

MinJ3 calculation. 
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1 92. The method of claim 88 wherein computing -log(l+ e"^" 8 ') begins as soon as 

any data is available from the A-B calculation without waiting for the A-B calculation to 
complete. 

5 93. The method of claim 88 wherein computing -log(l+ begins as soon as 

any data is available from the A-B calculation without waiting for the A-B calculation to 
complete. 

94. The method as in 88 wherein computing LnJ3 comprises: 
1 0 determining the sign of A - B; and 

using the result of said determination to compute LnJ3. 

95. The method as in claim 88 wherein computing LnJ3 comprises: 
computing the value of-log(l+ e*^' 81 ); 

1 5 computing the value of -log(l+ e" 18 ^); and 

selecting the correct value. 

96. The method as in claim 88 wherein computing Ln_J3 comprises: 
computing the value of -log(l+ e" tA * Bt ) + an offset; 

20 computing the value of-log(l+ e HB * A1 ) + an offset; and 

selecting the correct value. 

97. The method of claim 96 wherein the offset is equal to 0.5. 

25 98. The method of claim 95 wherein computing the value of -log(l+ e"^' 81 ) 

comprises computing the value of-log(l+ e* iA Bl ) to an accuracy of 2 bits. 

99. The method of claim .95 wherein computing the value of -log(l+ e" lB ' At ) 
comprises computing the value of (1+ e^ Al ) to an accuracy of 2 bits. 

30 

100. The method of claim 96 wherein computing the value of -log(l+ e*^' 81 ) + an 
offset comprises computing the value of -log(l+ e"* A " B| ) to an accuracy of 1 bit. 

101 . The method of claim 96 wherein computing the value of -log(l+ + an 
35 offset comprises computing the value of -log(l+ e" 1B " A| ) to an accuracy of 1 bit. 
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1 02. The method of claim 98 wherein computing the value of -log( 1 + e"^* 81 ) further 
comprises calculating the log value based on a partial result from the A-B population. 

103. The method of claim 98 wherein computing the value of -log(l+ e** B * A1 ) further 
comprises calculating the log value based on a partial result from the A-B population. 

104. A method as in claim 102 wherein the partial result comprises a three least 
significant bits of the A-B calculation. 

1 05. The method of claim 95 wherein computing the value of -log(l+ e' !A * B| ) is 
essentially simultaneous with computing the value of -log(l+ e"* 8 *^). 

106. A method as in claim 95 wherein selecting the correct value comprises: 
determining the sign bit of the A-B calculation; and 

using the sign bit to select the result of the -log(R e*^' 81 ) or the -log(l+ e* 18 "^) 

calculation. 

107. The method as in claim 95 wherein selecting the correct value comprises: 
determining the third bit of the A-B calculation; 

using the third bit to select the result of the -log(l+ e HA_B| ) or the -log(l+ e' 1B * A| ) 
calculation; and 

correcting for an error in selecting the result of the -log(l+ e"^' 81 ) or the 
-Iog(l+ e- iB_A| ) calculation. 

108. The method as in claim 95 wherein selecting the correct value comprises: 
determining a bit of the A-B calculation wherein the bit is located between the second bit up 
to and including the sign bit of the A-B calculation; 

using the determined bit to select the result of the -log(l+ e" ,A ' B1 ) or the -log(l+ 
e* 18 *^) calculation; and 

correcting for an error in selecting the result of the -log(l+ e' 1A * B| ) or the 
-log( 1 + e" |B * A| ) calculation. 

109. The method as in claim 107 wherein correcting for an error in selecting the 
result of the -log(l+ e^* 81 ) or the result of the -log(l+ e* 18 ^) calculation comprises: 

computing a value in a log saturation circuit; and 

combining the value computed in the log saturation circuit with the selected 
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1 result 



1 1 0. The method as in claim 109 wherein combining the value computed in the log 
saturation circuit with the selected result comprises ORing the value computed in the log 

5 saturation circuit with the selected result, 
accuracy of one bit. 

111. An apparatus for calculating a Min*(A,B) in a MAP decoder the apparatus 
comprising: 

a circuit for calculating the minimum (Min) of A and B where A is the sum of 
al and a2 and a3, wherein al is the min_a of a previous state, a2 is Ln_a of the previous 
state and a3 is equal to a priori values from a previous state plus a transition metric from a 
previous state and B is equal to bl and b2 and b3, wherein bl is the minjx of a previous 
state, b2 is Ln_a of the previous state and b3 is equal to a priori values from a previous state 
plus a transition metric from a previous state; and 

a circuit for calculating -log(l+ e HA * B1 ). 

112. The apparatus of claim 1 1 1 wherein the circuit for calculating the minimum 
(Min) of A and B comprises: 

20 a multiplexor that accepts A as one input and B as a second input; and 

a circuit that computes A-B and provides the sign bit of the A-B calculation as 
a control input to the multiplexor. 

113. The apparatus of claim 1 1 1 wherein the circuit for calculating -log(l + e* |A_B| ) 
comprises: 

a first circuit that calculates the value of -log(l+ e _lA " Bi ); 
a second circuit that calculates the value of -log(l+ e- iB " A| ); 
a mulltiplexor that chooses the calculation of the first circuit or the second 

circuit. 

114. The apparatus of claim 113 wherein the multiplexor is controlled by a bit of 
the A-B calculation. 

115. The apparatus of claim 108 further comprising circuitry that computes A, B, 
35 and A-B simultaneously. 
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10 



1 16. The apparatus of claim 1 14 wherein the bit of the A-B calculation is between 
the third bit of a result from the A-B calculation and a sign bit from the A-B calculation. 

1 1 7. The apparatus of claim 1 1 4 further comprising: 

an OR gate that receives that accepts a first output from the multiplexor; and 
a second output that accepts a second output from a log saturation circuit. 

118. A method as in claim 65 further comprising simultaneously computing A, B, 
and AB. 



119. An apparatus for calculating a Min*(A,B) in a MAP decoder the apparatus 
comprising: 

a circuit for calculating the minimum (Min) of A and B where A is the sum of 
al and a2 and a3, wherein al is the minJJ of a next state, a2 is LnJ3 of the next state and a3 
15 is equal to a priori values from a next state plus a transition metric into a next state and B is 
equal to bl and b2 and b3, wherein bl is the minJ3 of a next state, b2 is LnJ3 of the next 
state and b3 is equal to a priori values into a next state plus a transition metric into a next 
state; and 

a circuit for calculating -log(l+ e^* 8 '). 

20 

1 20. The apparatus of claim 119 wherein the circuit for calculating the minimum of 
A and B comprises: 

a multiplexor that accepts A as one input and B as a second input; and 
a circuit that computes A-B and provides the sign bit of the A-B calculation as 
25 a control input to the multiplexor. 

121. The apparatus of claim 1 19 wherein the circuit for calculating -log(l+ e" 1 *' 81 ) 
comprises: 

a first circuit that calculates the value of -log(l+ e*^' 81 ); 
30 a second circuit that calculates the value of-log(l+ e- 1B * A| ); 

a mulltiplexor that chooses the calculation of the first circuit or the second 

circuit. 

122. The apparatus of claim 121 wherein the multiplexor is controlled by a bit of 
35 the A-B calculation. 
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123. The apparatus of claim 1 16 further comprising circuitry that computes A, B, 
and A-B simultaneously. 

124. The apparatus of claim 122 wherein the bit of the A-B calculation is between 
the third bit of a result from the A-B calculation and a sign bit from the A-B calculation. 

125. The apparatus of claim 122 further comprising: 

an OR gate that receives that accepts a first output from the multiplexor; and 
a second output that accepts a second output from a log saturation circuit. 

126. A method of normalizing alpha (a) values in a map decoder the method 
comprising: 

detecting when all a values have reached a certain value; and 
subtracting a constant value from all a values on a next decoder cycle. 

127. The method of claim 126 wherein detecting when all a values have reached a 
certain value comprises determining when the most significant bit (MSB) of all the a values 
is set. 

128. The method of claim 127 wherein determining when the most significant bit of 
all the a values is set comprises ANDing the MSBs of all the a values. 

129. The method of claim 126 wherein subtracting a constant value from all a 
values on a next decoder cycle comprises subtracting a value equal to the MSB of the a 
values. 

130. The method of claim 129 wherein subtracting a value equal to the MSB of the 
a values comprises resetting the MSB of all the a values. 

131. The method of claim 130 wherein resetting the MSB of all the a values 
comprises: 

using the detection of all the MSBs of all the a values being equal to one to set 
the path of a multiplexer on a first decoding cycle; and 

accepting a zero value as the MSB of all the a values on a next decoding cycle. 

1 32. An apparatus for normalizing alpha (a) values in a map decoder the apparatus 
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1 comprising: 

a detector which detects when all a values have reached a certain value; and 
a subtractor a constant value from all a values on a next decoder cycle. 

5 133. The apparatus of claim 132 wherein the detector comprises an AND gate that 

receives as an input the MSBs of all the a values. 

1 34. The apparatus of claim 132 wherein the subtractor comprises: 

a multiplexer which receives a signal on a first decoding cycle to direct either a 
1 0 zero or the MSB through the multiplexer to the output of the multiplexer; and 

a a register that accepts the output of the multiplexer as the MSB on a next 
decoding cycle. 

135. A method of normalizing beta (P) values in a map decoder the method 
15 comprising: 

detecting when all p values have reached a certain value; and 
subtracting a constant value from all P values on a next decoder cycle. 

136. The method of claim 135 wherein detecting when all P values have reached a 
20 certain value comprises determining when the most significant bit (MSB) of all the P values 

is set 

137. The method of claim 136 wherein determining when the most significant bit of 
all the p values is set comprises ANDing the MSBs of all the p values. 

25 

138. The method of claim 135 wherein subtracting a constant value from all p 
values on a next decoder cycle comprises subtracting a value equal to the MSB of the a 
values. 

30 139. The method of claim 138 wherein subtracting a value equal to the MSB of the 

a values comprises resetting the MSB of all the P values. 

140. The method of claim 139 wherein resetting the MSB of all the p values 
comprises: 

35 using the detection of all the MSBs of all the p values being equal to one to set 

the path of a multiplexer on a first decoding cycle; and 
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10 



accepting a zero value as the MSB of all the P values on a next decoding cycle, 

141. An apparatus for normalizing P values in a map decoder the apparatus 
comprising: 

a detector which detects when all P values have reached a certain value; and 
a subtractor a constant value from all P values on a next decoder cycle. 

142. The apparatus of claim 141 wherein the detector comprises an AND gate that 
receives as an input the MSBs of all the p values. 



143. The apparatus of claim 141 wherein the subtractor comprises: 

a multiplexer which receives a signal on a first decoding cycle to direct either a 
zero or the MSB through the multiplexer to the output of the multiplexer; and 

a P register that accepts the output of the multiplexer as the MSB on a next 
1 5 decoding cycle. 

144. A method for parallel decoding of modulo N turbo encoded data, the method 
comprising: 

accepting samples of modulo N turbo encoded data; 
20 calculating metric values for each sample; 

accepting the metric values into each of N soft input soft output (SISO) 



modules; 



deinterleaving extrinsic values to form a priori values; 

accepting a priori values into each of N soft input soft output (SISO) modules; 



25 and 



performing decoding calculations within each of the SISOs thereby forming 
the extrinsic values; 

145 . The method of claim 144 wherein accepting samples of modulo N turbo 
30 encoded data comprises accepting an inphase (I) value and quadrature (Q) value 
representing samples of the turbo encoded data. 

146. The method of claim 144 wherein calculating metric values for each sample 
comprises calculating the distance between the sample and each possible transmitted 
35 constellation point. 
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1 147. The method of claim 144 wherein calculating metric values for each sample 

comprises calculating the Euclidean distance squared between the sample and each possible 
transmitted constellation point. 

5 148. The method of claim 147 wherein calculating the Euclidean distance squared 

comprises: 

determining a first distance, in the I direction, between the between the sample 
and a possible transmitted constellation point in the I direction; 

squaring the first distance to form the first distance squared; 
1 0 determining a second distance, in the Q direction, between the between the 

sample and a possible transmitted constellation point in the Q direction; 

squaring the second distance to form the second distance squared; and 

adding the first distance squared to the second distance squared to form the 
Euclidean distance squared. 

15 

149. The method of 144 wherein accepting the a priori values into each of N soft 
input soft output (SISO) modules further comprises accepting a value representing an equal 
likelihood that the sample point represents each valid constellation point on a first iteration 
of the decoder. 

20 

150. The method of claim 144 wherein deinterleaving extrinsic values to form a 
priori values comprises performing a deinterleaving using an inverse interleaver of an 
interleaver used to produce a corresponding interleaving; 

25 151. The method of claim 144 wherein performing decoding calculations within 

each of the SISOs thereby forming the extrinsic values comprises performing a MAP 
(maximum a posteriori) decoding. 

152. The method of claim 145 wherein performing decoding calculations within 

30 each of the SISOs thereby forming the extrinsic values comprises performing a SOVA (soft 
output Viterbi algorithm) decoding. 

153. The method of claim 146 wherein accepting samples of modulo N turbo 
encoded data comprises accepting samples of odd-even encoded data. 

35 

154. An apparatus for parallel decoding of modulo N turbo encoded data, the 
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1 apparatus comprising: 

an input queue that accepts samples of modulo N turbo encoded data; 
a metric calculator that accepts samples of modulo N turbo encoded data from 
the input queue and calculates the metric values for each sample; 
5 N soft input soft output (SISO) modules that accept the metric values and an a 

priori values and produce an extrinsic value; 

N modulo N deinterleavers that accept an extrinsic value and deinterlieave it to 
form an a priori value. 

10 155. The apparatus as in claim 1 54 wherein the input queue that accepts samples of 

modulo N turbo encoded data further comprises an input queue that accepts an inphase (I) 
value and quadrature (Q) values representing samples of the turbo encoded data. 

156. The apparatus as in claim 1 54 wherein the metric calculator comprises a 

1 5 calculator that calculates the distance between the sample and each possible transmitted 
constellation point. 

157. The apparatus as in claim 154 wherein the metric calculator is an Euclidean 
distance squared calculator that calculates the distance between the sample and each 

20 possible transmitted constellation point. 

158. The apparatus as in claim 154 wherein the deinterleaver comprises an inverse 
of the modulo N interieaver used to decode the turbo encoded data. 

25 159. The apparatus as in claim 1 54 wherein the SISO decoder is a MAP (maximum 

a posteriori) decoder. 

1 60. The apparatus as in claim 154 wherein the SISO decoder is a SOVA (soft 
output Viterbi algorithm) decoder. 

30 

161. An apparatus for parallel decoding of modulo N turbo encoded data, the 
apparatus comprising: 

means for accepting samples of modulo N turbo encoded data representing a 
block of turbo encoded data; 
35 means for calculating metrics metric that accepts samples of modulo N turbo 

encoded data from the sample accepting means and calculates the metric values for each 
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sample; 

N means for accepting a soft input and producing a soft output (SISO means) 
that accept the metric values and an a priori values and produce an extrinsic value; 

N modulo N deinterleaving means that accept an extrinsic value and 
deinterleave it to form an a priori value. 

162. The apparatus as in claim 161 further comprising a conditional points 
processor that accepts samples of modulo N turbo encoded data representing a block of 
turbo encoded data and produces conditional points. 

163. The apparatus as in claim 162 further comprising an output processor that 
accepts a priori values from the SISO means and conditional points from the conditional 
processor and computes output tuples. 



-89- 



This Page Blank (uspto) 



WO 02/23739 



1/65 



PCT/US01/28974 




This Page Blank (uspto) 



WO 02/23739 



2/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



3/65 



PCT/USOl/28974 




This Page Blank (uspto) 



WO 02/23739 



4/65 



PCT/US01/28974 




This Page Blank (uspto) 



WO 02/23739 



5/65 



PCT/USO 1/28974 



o 



o 



\ 



S 
ttJ 



OS 



Q 



Q 



-*<gH 1 



I, 

Cl4 



r- 



5 



This Page Blank (uspto) 



WO 02/23739 



6/65 



PCT/US01/28974 




Rate 2/3 basic constituent encoder 

Figure 6 



This Page Blank (uspto) 



WO 02/23739 



7/65 



PCT/USO 1/28974 




i 



1 


k 


Is 




EN 

[utional 
oder 


818* 


rV 






> o o 
« 5w 

o 


3 






O 





erieaver 
705 


J 


Int 





This Page Blank (uspto) 



WO 02/23739 



8/65 



PCT/USO 1/28974 



r 
— ► 



00 

-A. 

















1 




3 




* 


• • • 


3 


► 


.§» g-ss 



H2 



o 

CO 



\ 



8 

li 



5 



4 




A 




Encoder 2 
813 




Encoder 3 
815 





•5 5 

1- 



s 

li 
I 



3 



1 



55 

w 

•8 ^ 

R oo 







> 










On 
CN 


> 


°°\ 




• • 


5 




> 








• 
• 

f 




• 
• 

t 




• 

• 

f 





CO 

CO 



\ 



N 



f 



I 



E_ ... —J 



oo 

i 



H2 



This Page Blank (uspto) 



WO 02/23739 



9/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



10/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



11/65 



PCT/US01/28974 




Page Blank (usptGj 



WO 02/23739 



12/65 



PCT/USO 1/28974 



* 2 
2 



oding 


r 


u 
a 
HI 




u 


I 


a. 

£• 





n 



o 



o _ 



5P 



• •• 



• •• 



• •• 



• •• 



- s 

+. 2 fe 



t 8*8 



a. 

a. 



o 
o 

c — 
W 



A 4> 

3 fct§ 



5 



o 



o 

r-H 

0> 



o 
o 



a 

"V 

rH 
O 

o 



CO 

o 
o 



This Page Blank (uspto) 



WO 02/23739 



13/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



14/65 



PCT/US01/28974 



S 



■o g 



w 







i 




2 


j 


2 


JT 


2 






■J 


2 


J 


2* 




2 





\ 

-> H 
-=> W 
-> « 



2 = 





































1 < 


— ► 


CO 



o<- 



o<- 




(XI 

W 

0-5* 
o-$> 

ID 



Rate 2/3 
Encoder 
(Odd) ^ 


A 




2 




2 








2 


■J 


£ 




2 


►5 


2* 




2 





1—1 



PLi 



This Page Blank (uspto) 



WO 02/23739 



15/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



16/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



17/65 



PCT/USOl/28974 



1400 



[5, I4, Ij, I 2 , I|, Io 



Seed Interleaving Sequence = 3, 0, 1, 5, 4, 2 



1409 Output Sequence 



Intlv 1401 



lo 


3 


I, 


0 


I2 


1 


ly 


5 


I4 


4 


„I5 


2 




I3, l4» Io> I$t Ifc h 
^ Seed Sequence 

Sequence #1 = 3, 4, 0, 5, 2, 



Input Position" 
Corresponding Output Position 



1400 



1411 Output Sequence 



h> U> h> I* h> h 



Intlv" 1 1403 



Ij 


0 


Io 


1 


I, 


2 


15 


3 


I4 


4 




5 




I* h> I5, h* Io, h 



v Inverse of seed sequence 

Sequence #2 == 2, 4, 5, 1, 0, 3 



Input Position^ 
Corresponding Output Position 



1413 Output Sequence 



1$, h> h» lb Io 



IntrvR 1405 



Io 


2 


I. 


4 


I2 


5 


I, 


1 


I4 


0 


-I5 


3 




Time reversal of seed sequence 

Sequence #3 = 2, 1, 5, 0, 3, 4 



Input Position 

Corresponding Output Position ' 



Is* !♦» I3* Ia» 1 1, Io 



IntrvR"' 1407 





5 


Io 


4 


II 


3 


Is 


2 


u 


1 


_.I 2 


0 



I3, Io, Ii> I5, I2 



14150utput Sequence 



Time reversal of the inverse of the seed sequence 



Sequence #4 = 3, 0, 1,5,4,2 



Input Position" 
Corresponding Output Position 



Figure 14A 



This Page Blank (uspto) 



WO 02/23739 



18/65 



PCT/US01/28974 



Table 1 



Q An 44 1 




3 




4 




0 




5 




2 




1 


Seq. #2 


2 




4 




5 




1 




0 




3 




Seq. 1-2 


2 


3 


4 


4 


5 


0 


1 


5 


0 


2 


3 


1 






.Table 2 






Position 


11 


10 


9 


8 


7 


6 


5 


4 


3 


2 


1 


0 


Seq. 1-2 


2 


3 


4 


4 


5 


0 


1 


5 


0 


2 


3 


1 


X2(Mod) 


4 


6 


8 


8 


10 


0 


2 


10 


0 


4 


6 


2 


+ mod2 
(Position) 


+1 


+0 


+1 


+0 


+1 


40 


+1 


+0 


+1 


+0 


+1 


+0 


Seq. 5 


5 


6 


9 


8 


11 


0 


3 


10 


1 


4 


7 


2 








Table 3 






Seq. #3 




2 




1 




5 




0 




3 




4 


Seq. #4 


3 




0 




1 




5 




4 




2 




Seq. 3-4 


3 


2 


0 


1 


1 


5 


5 


0 


4 


3 


2 


4 






Table 4 






Position 


11 


10 


9 


8 


7 


6 


5 


4 


3 


2 


1 


0 


Seq.3-4 


3 


2 


0 


1 


1 


5 


5 


0 


4 


3 


2 


4 


X2(Mod) 


6 


4 


0 


2 


2 


10 


10 


0 


8 


6 


4 


8 


+ mod2 
(Position) 


+1 


+0 


+1 


+0 


+1 


+0 


+1 


+0 


+1 


+0 


+1 


+0 


Seq. 6 


7 


4 


1 


2 


3 


10 


11 


0 


9 


6 


5 


8 



Seq.#l 






3 






4 






0 






5 






2 






1 


Sea. #2 




2 






4 






5 






1 






0 






3 




Seq. #3 


2 






1 






5 






0 






3 






4 






Seq.1-2-3 


2 


2 


3 


1 


4 


4 


5 


5 


0 


0 


1 


5 


3 


0 


2 


4 


3 


1 



Table 6 



Position 


17 


16 


15 


14 


13 


12 


11 


10 


9 


8 


7 


6 


5 


4 


3 


2 


1 


0 


Seq 1-2-3 


2 


2 


3 


1 


4 


4 


5 


5 


0 


0 


1 


5 


3 


0 


2 


4 


3 


1 


X3(Mod) 


6 


6 


9 


3 


12 


12 


15 


15 


0 


0 


3 


15 


9 


0 


6 


12 


9 


3 


+ mod 3 
(Position) 


2 


1 


0 


2 


1 


0 


2 


1 


0 


2 


1 


0 


2 


1 


0 


2 


1 


0 


Seq. 7 


8 


7 


9 


5 


13 


12 


17 


16 


0 


2 


4 


15 


11 


1 


6 


14 


10 


3 



Figure 14B 



This Page Blank (uspto) 



WO 02/23739 



19/65 



PCT/US01/28974 



o 

i 





















CO 






Ti- 




Tt 








CN 


CN 


CN 








<N 




O 






O 






ro 




to 








*T 












v> 
















O 




O 










*rt 


O 








O 










v-> 






»n 
















Ti- 




































o 


o 


ro 








ro 




CN 






<N 






CN 




rs 








ro 


ro 


5b 


cn 
% 


2 




t 
ro 

CN 


C 
c 
w 


Sea. 


Sea. 


Sea. 


1 Seq.U 



© 






o 






ro 


CN 




ro 


cn 


-<* 


VO 


CN 


00 


ro 


cn 


00 


ro 


^4 




CN 


00 


o 


00 




o 


o 




~* 


SO 


ro 


CN 


CN 




r- 




NO 


CO 




00 


w-> 


O 
CN 


O 


o 

CN 




1—1 


Tj- 




*n 


o 


O 


O 


CN 


CN 




v% 


o 

CN 


CO 


CO 
CN 


cn 


o 


O 


o 


o 


*o 


<n 


o 

CN 




CN 




vn 


o 

CN 


CN 


CN 
CN 




f-- 




co 




NO 

»•« 


Tf 


\© 


o 


*-« 




Tf 






r- 


00 






CN 


\o 




o 


o 


CO 


ro 


o 

CM 


co 


CN 


o 


CN 


CN 


(N 


OO 






CN 
CN 


CN 


oo 


CN 


© 


m 

CN 


ro 




ro 




a 
c 

X 

"5 
a 
a 


ro 

8 

C/3 


% 

3 


" ^ 'c 
^ c 

-81 
+ e 


■ V— — C_ 

Seq. 8 



fa 



This Page Blank (uspto) 



WO 02/23739 



20/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 PCT/USO 1/28974 

21/65 




This Page Blank (uspto) 



WO 02/23739 



22/65 



PCT/US01/28974 




This Page Blank (uspto) 



WO 02/23739 



23/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



24/65 



PCT/USO 1/28974 



t 















1 


8 


CO 




En 





o 

oo 

i 

bo 
fa 




oo 



fa 



CO 
i— I 

<D 
fa 



111 



TJ T) Q 



7 

□ 



o 

CO 
fa 



\ 



This Page Blank (uspto) 



WO 02/23739 



25/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/237J9 



26/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



27/65 



PCT/USOt/28974 




This Page Blank (uspto) 



WO 02/23739 



PCT/USO 1/28974 



28/65 




This Page Blank (usptoj 



WO 02/23739 



29/65 



PCT/LSOl/28974 




This Page Blank (uspto) 



WO 02/23739 PCT/US01/28974 

30/65 



Map 0 



on 

o 


no 






o 




T) 






101 

o 




o 


0.P 


Q„ 





Figure 22 



Map 1 



010 

o 


001 


T) 


o°" 


111 

0 


o'°° 


,.p 


Q,o 



Figure 23 



This Page Blank (uspto) 



WO 02/23739 



31/65 



PCT/USO 1/28974 



Map 2 



• 7 


• 6 


• 1 


• 3 


0000 


0101 


0110 


0011 


• 5 


• 4 


• 0 


• 2 


0111 


0010 


1000 


0100 


• 9 


• S 


• 12 


• 13 


1100 


1011 


1000 


mi 


• 11 


• 10 


• 14 


• 15 


1001 


1110 


1101 


1010 



Figure 24 



This Page Blank (uspto) 



WO 02/23739 PCT/USO 1/28974 

32/65 



Map 3 



• 7 


• 6 


• 1 


• 3 


00 






01 


• 5 


• 4 


• 0 


• 2 


• 9 


• 3 


• 12 


• 13 


• 11 


• 10 


• 14 


• 15 


11 






10 



Figure 25 



This Page Blank (uspto) 



WO 02/23739 



33/65 



PCT/USO 1/28974 



CO 








CO 


CM 


O 




Li. 




UL 



CO 
CM 

J2 
c 

2 

CO 

c 
o 




CO 




00 


o 




o 


CO 




CO 


CN 




CN 


o 




o 


CO 




CO 


CO 




CO 




3 « CO 

3 O CO 
O 2 CN 

CL 



CO CO 

■o (D 

O "q. 

O 3 

CD iZ 

Q ^ 



CO 
CN 



CO 
CN 

LU 

ce 
z> 
o 



L. CO 

-S * o CN 

3£OJDO 

•ken i >,cn 
o co 



00 



O 

CO 



This Page Blank (uspto) 



WO 02/23739 



34/65 



PCT/USO 1/28974 




T3 



& 

It. 



11- 

u 



3 3 £* 



This Page Blank (uspto) 



WO 02/23739 



35/65 



PCT/USO 1/28974 




00 

i 



1* 




This Page Blank (uspto) 



WO 02/23739 



36/65 



PCT/USO 1/28974 





05 

CM 

u 



TO 












w-» tT ro 




2 < o 




T2 


' -*V.F; - -i^^jv 








T3 


= 2 <* 

o o u 




2 < cu o 





This Page Blank (uspto) 



WO 02/23739 



37/65 



PCT/USO 1/28974 



«3 - 

I I 

A | 

a Zl 

w o 

II 0 



§■1 |.l | 

H Oh W 2 

/ / 



o. 

Eh 












i— i 
Eh 


u o 


O 




g < O. cn 




(N 
Eh 




.it***.;/"-' 








CO 
Eh 


r- <o 

o u 


O 




<J Qh ro 





This Page Blank (uspto) 



WO 02/2 J7J9 



38/65 



PCT/USO 1/28974 



w 

It 



T3 

i 

o 



T3 
o 

O 

o 




2 
G 



CO 



o 




Si 










«A V 

o u u 


fflf 




^ < Oh (N 








.-' . ■ iT. 

il 








CO 


— o 

~- — 0\ 

u o u 






^ < CL, CN 





This Page Blank (uspto) 



WO 02/23739 



39/65 



PCT/US0 1/28974 



a 



«3 o o 

T5 > *- 



§«2 m 

a; fi •§ 

ex. ao o 



«4U 

'So* 
CQI 03 a. 



coder 


oder 


cS 


Enc 


c 


*T3 




T3 




O 


n 


tJ 



TO 






iilllli 




*— t 
&« 












vr» tt m 

a o o 




^ < Pu o 




T3 


am CQ 


















1 T5 






- Sfcx J5-i5 > r >i . 




CD 

£-* 


— © 

— — G\ 

u o o 




2 <J P- o 




T7 


OQIOQ OQ 




S < Oh - 





CO 



Page Blank (uspto) 



WO 02/237J9 



40/65 



PCT/LS01/28V74 



T3 

a> 

."2 
> 

g 

s I 

.2 -a -n 

•S .2 C 

8*° 3 

ii-5 

« £V ** 



-8 

o 



■S|5 

mitt 



a 



a 
W 

T3 
O 



o 
H 


§SSI 


r ofFigur 






i—i 




■8 
o 
u 
a 

V 

s* 


iiftif 


O 


CN 




ace 3301 

U1C iolC 




juence 3; 


CO 


»a tt m 

u o u 


le Seque 
iiicca oy 




u 
CO 

r- 


E-» 


ooj r- vo 

CQICQ CO 


S 2 
f- a. 




1 




d 2 * 
CQICQ m 


t 




/- 


CO 

E« 






PS 














00 
Eh 






SH 






= 2 os 

u u u 




^ <J em © 




TIO 


OJ OS oo 








Til 


« N 




s < * - 





CO 
CO 

s 

0JD 



This Page Blank (uspto) 



WO 02/23739 



41/65 



PCT/USO 1/28974 



CO 



oo 



CO 



■a! 




3411 


Ca 






CO 



This Page Blank (usptoj 



WO 02/23739 



42/65 



PCT/US01/28974 




This Page Blank (uspto) 



WO 02/23739 



43/65 



PCT/US01/28974 




This Page Blank (uspto) 



WO 02/23739 



PCT/IS0I/28974 



44/65 




Figure 37 



[his Page Blank (uspto) 



WO 02/23739 



45/65 



PCT/USO 1/28974 




o 

CO 



O 
O 



£ I 

| § 

•a j? 

a s 

CO g 

JO 0 

II 



II 

I 



00 
CO 

• i— < 



Si 



ii 

J 




This Page Blank (uspto) 



WO 02/23739 



46/65 



PCT/US01/28974 




3 

CQ 
<D 



This Page Blank (uspto) 



WO 02/23739 



47/65 



PCT/US01/28974 



o 

iC, 

a 

Cf. 



c 
p. 



co 

CO 

I 

> 



o 



3 

o 

- 



CO 

CO 



x 



O <^ 

00 



CO 
lO 

CO 

a>< 

I 

o 

'*£ 



> 

> 



O ^ 
GO £ 



CO 
CD 
CO 

M 

g 
'u 
_9=l 



0> 

o 



> 

*3 



CO 

o 

CO 

.3 

u 
X 



O £ 



00 



-or 

CO 
O 
CO 

a> 

> 

'u 

.2 















SJ 




1 












o 














■4—* 

.s 




e 


"3 




S 














b 




































c 















co 

CAJO 



This Page Blank (uspto) 



WO 02/23739 



48/65 



PCT/USOl/28974 




This Page Blank (uspto) 



WO 02/23739 



49/65 



PCT/USOI/28974 



• •• 



8 (S 



a o 




3 o 



• 



s 2 



«2 





0\ 




o 


« 


o 


5o 





fa 



§ * 



This Page Blank (uspto) 



WO 02/23739 



50/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



51/65 



PCT/US01/28974 



CD 

o 

CO 

I 



00 

o 

CO 
<N 

td 

3 



> 

a 



3 



en 



«-0 



inv 


cn 


Q 


m 

Ti- 


> 






en 



to o 

8 2 5 
3-8 



CO 

•iH 
fa 



> 




Din 


o 


j> 


m 
o 


I 


m 



CO 

o 

CO 

<N 

<3 



00 

o 

CO 

CN 

I 



This Page Blank (usptoj 



WO 02/237J9 



52/65 



PCT/USO 1/28974 



o . 



o <-< 

: : 

• • 



Q oo 
«J o 













S 


o 


• • 






























< 






u 


Q 


w 


— &■ 







rv. 

rH 




t-H 




Pr. 


o 

T-H 












00 




CO 


I- 


CO 


Q 


CO 


O 






<N 


o 


^ 


CO 


i-H 


00 


»— » 




<N 


<: 


o 


rH 


o 


<: 


1 Number 1 


4405 


4407 



^5 





o 


< 


i— 1 




o 


o 


i-H 






PQ 




oo 


(N 


o 




o 




CD 


oo 


Q 


lO 


P 


00 


Tj* 






CO 


(3 




<N 






r-4 






Number 1 


4421 


4422 



This Page Blank (uspto) 



WO 02/23739 PCT/USO 1/28974 

53/65 



Encoder a (likelihood) 
At time = k 



Encoder a (likelihood) 
At time = k+1 



4503 
ajc(0)-State 0 Qy 

Path 2 "] 
Input =10 y 
Output" 101 J 4505 
aic(l) State 1 



Path 3 
Input = 1 1 
Output=110J 4507( 
Oit(2) State 2 

Path 
Input =• 01 
Output=0lH 4509* 
ak(3) State 3 



State 4 



0 



State 5 



0 



State 6 



0 



0 



Path 1 
Input = 00 
Output^QOQ 



4511 




Wko) 



State 7 



O 
O 

o 
o 



Figure 45 



This Page Blank (uspto) 



I 



WO 02/23739 



54/65 



PCT/USO 1/28974 



§ 




-a 

.2 j? 

^ Q 

3 




3 

1 



-S ° 




S o 
« vo 
2 ^ 



QQ 



This Page Blank (uspto) 



WO 02/23739 



55/65 



PCT/USO 1/28974 



i 

II 

a 

o 

* 

.5 





Min* 




Min* 






Min* 









O o 

•a 

° 2 

u u 

< < 

+ + 

II 



ii ii 
o o 



.2 
u 

en 
+ 



■a 

+ 



CD 

3 



This Page Blank (uspto) 



WO 02/23739 



56/65 



PCT/USO 1/28974 



o , 



o o 

< CD 

< CD 

CM CM 

< CD 

< CO 



o 
CO 

CO 

CO 

CO 

J 




So 

CO 
O 



< < < < 



CO 

CD 



O ^ CM CO /TS 

CQ CQ CO CQ ^ 
©©©©<=> 



2 
Li. 



This Page Blank (uspto) 



WO 02/23739 



57/65 



PCT/US01/28974 






der 


o 


CO 3 




CO 


< 





O O O 

II II 
- § 

•g .2 



o 
II 

o 



.2 

Sh 
fin 

+ 

I— I 

II 

1— ( 

.-a 

«s 
•a 

•a 

+ 



o o 

II II 

o o 

•p-H •»-» 



3 



O 

•i-H 
?H 
(X, 

+ 

o 
il 

e 

.2 

Ph 

<J 
+^ 



o 
Ph 

+ 

il 



.2 
Ph 



CO 
+ 

5 



o 

CO 
+ 

e 
3 



This Page Blank (uspto) 



WO 02/23739 



58/65 



PCT/US01/28974 



C O aj T3 O 
3 O j- *o 00 
U J < < ^ 




00 

u 
ho 



This Page Blank (uspto) 



WO 02/23739 



59/65 



PCT/liSO 1/28974 




This Page Blank (uspto) 



WO 02/23739 



PCT/USO 1/28974 



60/65 




This Page Blank (uspto) 



WO 02/23739 



61/65 



PCT/USOt/28974 




This Page Blank (uspto) 



WO 02/23739 



62/65 



PCT/USO 1/28974 




This Page Blank (uspto) 



* 



WO 02/23739 



63/65 



PCT/US01/28974 



5113 Out | 


in 
d 


m 
d 


o 


o 


o 


o 


o 


o 


o 


o 


o 


o 


o 


ID ' 

d 


in 
d 


in 
d 


A (2:0) | 


1.75 


1.50 


1.25 


1.00 


0.75 


0.50 


0.25 


OO'O 


m 

CM 

d 
* 


-0.50 


in 

d 

. i 


-1.00 


in 

CM 

1 


-1.50 


-1.75 


-2.00 



ft 




i if n. 

oci . — — O c> o ^- ->r — >^ CJO*^ <^> 

-O oooo o o <o ^ ^ . Q> o 



& \ 0 — 

ii- I S> «5> O O Q ^ O O O Q> O ^ -^r — _ — 

V> t ^ — ** A o O o o ^0 — ^ ~ — — 

SO 1 ^ — G> p £> <Z> <? ^oO^^ - *^^" — ~ 

/— ] S — <oO^>^>Oc^O«)QO-*--^-^-r 

0© I «S> © Q O O o^OOO— — — — i — — _ 

<r~c^ O <O^OOOQ>^0^0*~ — — ■ — 




O 

o 



o» 



i 

•H 



This Page Blank (uspto) 



WO 02/23739 



64/65 



PCT/U SO 1/28974 





















*> 


o 


to 






to 




Regi 




5 


Regi 






CO 


p 


o 



0) 

bo 

• i-i 



PC 



« 





Min* 
5205 







This Page Blank (uspto) 



WO 02/23739 



PCT/USO 1/28974 



65/65 
















— « 




OA 









a> 

bo 
fa 



Page Blank (uspto) 



